Aug 14 12:01:14 user nova-compute[73012]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 14 12:01:17 user nova-compute[73012]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73012) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73012) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73012) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 12:01:17 user nova-compute[73012]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:01:17 user nova-compute[73012]: INFO nova.virt.driver [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 14 12:01:17 user nova-compute[73012]: INFO nova.compute.provider_config [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] Acquiring lock "singleton_lock" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] Acquired lock "singleton_lock" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] Releasing lock "singleton_lock" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] Full set of CONF: {{(pid=73012) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ******************************************************************************** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] Configuration options gathered from: {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ================================================================================ {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] allow_resize_to_same_host      = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] arq_binding_timeout            = 300 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] backdoor_port                  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] backdoor_socket                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] block_device_allocate_retries  = 300 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] block_device_allocate_retries_interval = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cert                           = self.pem {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute_monitors               = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] config_dir                     = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] config_drive_format            = iso9660 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] config_source                  = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] console_host                   = user {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] control_exchange               = nova {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cpu_allocation_ratio           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] daemon                         = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] debug                          = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] default_access_ip_network_name = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] default_availability_zone      = nova {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] default_ephemeral_format       = ext4 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] default_schedule_zone          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] disk_allocation_ratio          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] enable_new_services            = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] enabled_apis                   = ['osapi_compute'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] enabled_ssl_apis               = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] flat_injected                  = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] force_config_drive             = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] force_raw_images               = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] graceful_shutdown_timeout      = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] heal_instance_info_cache_interval = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] host                           = user {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] instance_build_timeout         = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] instance_delete_interval       = 300 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] instance_format                = [instance: %(uuid)s]  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] instance_name_template         = instance-%08x {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] instance_usage_audit           = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] instance_usage_audit_period    = month {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] internal_service_availability_zone = internal {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] key                            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] live_migration_retry_count     = 30 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] log_config_append              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] log_dir                        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] log_file                       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] log_options                    = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] log_rotate_interval            = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] log_rotate_interval_type       = days {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] log_rotation_type              = none {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] long_rpc_timeout               = 1800 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] max_concurrent_builds          = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] max_concurrent_live_migrations = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] max_concurrent_snapshots       = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] max_local_block_devices        = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] max_logfile_count              = 30 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] max_logfile_size_mb            = 200 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] maximum_instance_delete_attempts = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] metadata_listen                = 0.0.0.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] metadata_listen_port           = 8775 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] metadata_workers               = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] migrate_max_retries            = -1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] mkisofs_cmd                    = genisoimage {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] my_ip                          = 10.0.0.210 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] network_allocate_retries       = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] osapi_compute_listen_port      = 8774 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] osapi_compute_unique_server_name_scope =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] osapi_compute_workers          = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] password_length                = 12 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] periodic_enable                = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] periodic_fuzzy_delay           = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] pointer_model                  = ps2mouse {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] preallocate_images             = none {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] publish_errors                 = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] pybasedir                      = /opt/stack/nova {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ram_allocation_ratio           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] rate_limit_burst               = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] rate_limit_except_level        = CRITICAL {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] rate_limit_interval            = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] reboot_timeout                 = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] reclaim_instance_interval      = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] record                         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] reimage_timeout_per_gb         = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] report_interval                = 120 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] rescue_timeout                 = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] reserved_host_cpus             = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] reserved_host_disk_mb          = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] reserved_host_memory_mb        = 512 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] reserved_huge_pages            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] resize_confirm_window          = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] resize_fs_using_block_device   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] resume_guests_state_on_host_boot = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] rpc_response_timeout           = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] run_external_periodic_tasks    = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] running_deleted_instance_action = reap {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] running_deleted_instance_poll_interval = 1800 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] running_deleted_instance_timeout = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler_instance_sync_interval = 120 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_down_time              = 720 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] servicegroup_driver            = db {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] shelved_offload_time           = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] shelved_poll_interval          = 3600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] shutdown_timeout               = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] source_is_ipv6                 = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ssl_only                       = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] state_path                     = /opt/stack/data/nova {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] sync_power_state_interval      = 600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] sync_power_state_pool_size     = 1000 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] syslog_log_facility            = LOG_USER {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] tempdir                        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] timeout_nbd                    = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] transport_url                  = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] update_resources_interval      = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] use_cow_images                 = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] use_eventlog                   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] use_journal                    = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] use_json                       = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] use_rootwrap_daemon            = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] use_stderr                     = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] use_syslog                     = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vcpu_pin_set                   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plugging_is_fatal          = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plugging_timeout           = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] virt_mkfs                      = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] volume_usage_poll_interval     = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] watch_log_file                 = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] web                            = /usr/share/spice-html5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_concurrency.disable_process_locking = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.auth_strategy              = keystone {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.compute_link_prefix        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.dhcp_domain                = novalocal {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.enable_instance_password   = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.glance_link_prefix         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.instance_list_per_project_cells = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.list_records_by_skipping_down_cells = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.local_metadata_per_cell    = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.max_limit                  = 1000 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.metadata_cache_expiration  = 15 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.neutron_default_tenant_id  = default {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.use_forwarded_for          = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.use_neutron_default_nets   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.vendordata_dynamic_targets = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.vendordata_jsonfile_path   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.backend                  = dogpile.cache.memcached {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.backend_argument         = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.config_prefix            = cache.oslo {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.dead_timeout             = 60.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.debug_cache_backend      = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.enable_retry_client      = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.enable_socket_keepalive  = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.enabled                  = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.expiration_time          = 600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.hashclient_retry_attempts = 2 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_dead_retry      = 300 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_password        =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_pool_maxsize    = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_sasl_enabled    = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.memcache_username        =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.proxies                  = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.retry_attempts           = 2 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.retry_delay              = 0.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.socket_keepalive_count   = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.socket_keepalive_idle    = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.socket_keepalive_interval = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.tls_allowed_ciphers      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.tls_cafile               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.tls_certfile             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.tls_enabled              = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cache.tls_keyfile              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.auth_section            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.auth_type               = password {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.cafile                  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.certfile                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.collect_timing          = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.cross_az_attach         = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.debug                   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.endpoint_template       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.http_retries            = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.insecure                = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.keyfile                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.os_region_name          = RegionOne {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.split_loggers           = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cinder.timeout                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.cpu_dedicated_set      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.cpu_shared_set         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.image_type_exclude_list = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.max_concurrent_disk_ops = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.max_disk_devices_to_attach = -1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.resource_provider_association_refresh = 300 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.shutdown_retry_interval = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] conductor.workers              = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] console.allowed_origins        = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] console.ssl_ciphers            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] console.ssl_minimum_version    = default {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] consoleauth.token_ttl          = 600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.cafile                  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.certfile                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.collect_timing          = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.connect_retries         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.connect_retry_delay     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.endpoint_override       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.insecure                = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.keyfile                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.max_version             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.min_version             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.region_name             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.service_name            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.service_type            = accelerator {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.split_loggers           = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.status_code_retries     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.status_code_retry_delay = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.timeout                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] cyborg.version                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.backend               = sqlalchemy {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.connection            = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.connection_debug      = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.connection_parameters =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.connection_recycle_time = 3600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.connection_trace      = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.db_inc_retry_interval = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.db_max_retries        = 20 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.db_max_retry_interval = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.db_retry_interval     = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.max_overflow          = 50 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.max_pool_size         = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.max_retries           = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.mysql_enable_ndb      = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.mysql_wsrep_sync_wait = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.pool_timeout          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.retry_interval        = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.slave_connection      = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] database.sqlite_synchronous    = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.backend           = sqlalchemy {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.connection        = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.connection_debug  = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.connection_parameters =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.connection_recycle_time = 3600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.connection_trace  = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.db_inc_retry_interval = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.db_max_retries    = 20 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.db_max_retry_interval = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.db_retry_interval = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.max_overflow      = 50 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.max_pool_size     = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.max_retries       = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.mysql_enable_ndb  = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.pool_timeout      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.retry_interval    = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.slave_connection  = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] api_database.sqlite_synchronous = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] devices.enabled_mdev_types     = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ephemeral_storage_encryption.enabled = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.api_servers             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.cafile                  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.certfile                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.collect_timing          = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.connect_retries         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.connect_retry_delay     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.debug                   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.default_trusted_certificate_ids = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.enable_certificate_validation = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.enable_rbd_download     = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.endpoint_override       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.insecure                = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.keyfile                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.max_version             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.min_version             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.num_retries             = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.rbd_ceph_conf           =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.rbd_connect_timeout     = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.rbd_pool                =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.rbd_user                =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.region_name             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.service_name            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.service_type            = image {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.split_loggers           = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.status_code_retries     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.status_code_retry_delay = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.timeout                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.verify_glance_signatures = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] glance.version                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] guestfs.debug                  = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.config_drive_cdrom      = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.config_drive_inject_password = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.enable_instance_metrics_collection = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.enable_remotefx         = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.instances_path_share    =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.iscsi_initiator_list    = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.limit_cpu_features      = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.power_state_check_timeframe = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.use_multipath_io        = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.volume_attach_retry_count = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.vswitch_name            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:17 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] mks.enabled                    = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] image_cache.manager_interval   = 2400 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] image_cache.precache_concurrency = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] image_cache.remove_unused_base_images = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] image_cache.subdirectory_name  = _base {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.api_max_retries         = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.api_retry_interval      = 2 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.auth_section            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.auth_type               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.cafile                  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.certfile                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.collect_timing          = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.connect_retries         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.connect_retry_delay     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.endpoint_override       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.insecure                = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.keyfile                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.max_version             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.min_version             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.partition_key           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.peer_list               = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.region_name             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.serial_console_state_timeout = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.service_name            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.service_type            = baremetal {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.split_loggers           = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.status_code_retries     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.status_code_retry_delay = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.timeout                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ironic.version                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] key_manager.fixed_key          = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.barbican_api_version  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.barbican_endpoint     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.barbican_endpoint_type = public {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.barbican_region_name  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.cafile                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.certfile              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.collect_timing        = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.insecure              = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.keyfile               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.number_of_retries     = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.retry_delay           = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.send_service_user_token = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.split_loggers         = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.timeout               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.verify_ssl            = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican.verify_ssl_path       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican_service_user.auth_section = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican_service_user.auth_type = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican_service_user.cafile   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican_service_user.certfile = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican_service_user.collect_timing = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican_service_user.insecure = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican_service_user.keyfile  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican_service_user.split_loggers = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] barbican_service_user.timeout  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.approle_role_id          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.approle_secret_id        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.cafile                   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.certfile                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.collect_timing           = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.insecure                 = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.keyfile                  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.kv_mountpoint            = secret {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.kv_version               = 2 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.namespace                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.root_token_id            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.split_loggers            = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.ssl_ca_crt_file          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.timeout                  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.use_ssl                  = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.cafile                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.certfile              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.collect_timing        = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.connect_retries       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.connect_retry_delay   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.endpoint_override     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.insecure              = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.keyfile               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.max_version           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.min_version           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.region_name           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.service_name          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.service_type          = identity {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.split_loggers         = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.status_code_retries   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.status_code_retry_delay = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.timeout               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] keystone.version               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.connection_uri         =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.cpu_mode               = custom {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: WARNING oslo_config.cfg [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.cpu_power_governor_high = performance {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.cpu_power_governor_low = powersave {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.cpu_power_management   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.device_detach_attempts = 8 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.device_detach_timeout  = 20 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.disk_cachemodes        = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.disk_prefix            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.enabled_perf_events    = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.file_backed_memory     = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.gid_maps               = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.hw_disk_discard        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.hw_machine_type        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.images_rbd_glance_store_name =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.images_rbd_pool        = rbd {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.images_type            = default {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.images_volume_group    = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.inject_key             = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.inject_partition       = -2 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.inject_password        = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.iscsi_iface            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.iser_use_multipath     = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_bandwidth = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_downtime = 500 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_inbound_addr = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_permit_post_copy = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_scheme  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_timeout_action = abort {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_tunnelled = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: WARNING oslo_config.cfg [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 14 12:01:18 user nova-compute[73012]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 14 12:01:18 user nova-compute[73012]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 14 12:01:18 user nova-compute[73012]: and ``live_migration_inbound_addr`` respectively.
Aug 14 12:01:18 user nova-compute[73012]: ).  Its value may be silently ignored in the future.
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.live_migration_with_native_tls = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.max_queues             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.nfs_mount_options      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.num_memory_encrypted_guests = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.num_pcie_ports         = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.pmem_namespaces        = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.quobyte_client_cfg     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rbd_secret_uuid        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rbd_user               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.remote_filesystem_transport = ssh {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rescue_image_id        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rescue_kernel_id       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rescue_ramdisk_id      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.rx_queue_size          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.smbfs_mount_options    =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.snapshot_compression   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.snapshot_image_format  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.sparse_logical_volumes = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.swtpm_enabled          = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.swtpm_group            = tss {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.swtpm_user             = tss {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.sysinfo_serial         = unique {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.tb_cache_size          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.tx_queue_size          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.uid_maps               = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.use_virtio_for_bridges = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.virt_type              = kvm {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.volume_clear           = zero {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.volume_clear_size      = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.volume_use_multipath   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.vzstorage_cache_path   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.vzstorage_mount_user   = stack {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.auth_section           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.auth_type              = password {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.cafile                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.certfile               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.collect_timing         = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.connect_retries        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.connect_retry_delay    = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.default_floating_pool  = public {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.endpoint_override      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.extension_sync_interval = 600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.http_retries           = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.insecure               = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.keyfile                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.max_version            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.min_version            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.ovs_bridge             = br-int {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.physnets               = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.region_name            = RegionOne {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.service_metadata_proxy = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.service_name           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.service_type           = network {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.split_loggers          = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.status_code_retries    = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.status_code_retry_delay = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.timeout                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] neutron.version                = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] notifications.bdms_in_notifications = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] notifications.default_level    = INFO {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] notifications.notification_format = unversioned {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] notifications.notify_on_state_change = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] pci.alias                      = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] pci.device_spec                = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] pci.report_in_placement        = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.auth_section         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.auth_type            = password {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.cafile               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.certfile             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.collect_timing       = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.connect_retries      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.connect_retry_delay  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.default_domain_id    = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.default_domain_name  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.domain_id            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.domain_name          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.endpoint_override    = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.insecure             = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.keyfile              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.max_version          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.min_version          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.password             = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.project_domain_id    = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.project_domain_name  = Default {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.project_id           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.project_name         = service {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.region_name          = RegionOne {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.service_name         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.service_type         = placement {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.split_loggers        = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.status_code_retries  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.status_code_retry_delay = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.system_scope         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.timeout              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.trust_id             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.user_domain_id       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.user_domain_name     = Default {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.user_id              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.username             = placement {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] placement.version              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.cores                    = 20 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.count_usage_from_placement = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.injected_file_content_bytes = 10240 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.injected_file_path_length = 255 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.injected_files           = 5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.instances                = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.key_pairs                = 100 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.metadata_items           = 128 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.ram                      = 51200 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.recheck_quota            = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.server_group_members     = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] quota.server_groups            = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] rdp.enabled                    = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.image_metadata_prefilter = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.max_attempts         = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.max_placement_results = 1000 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.query_placement_for_availability_zone = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.query_placement_for_image_type_support = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] scheduler.workers              = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.host_subset_size = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.isolated_hosts = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.isolated_images = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.pci_in_placement = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.track_instance_changes = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] metrics.required               = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] metrics.weight_multiplier      = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] metrics.weight_setting         = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] serial_console.enabled         = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] serial_console.port_range      = 10000:20000 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] serial_console.serialproxy_port = 6083 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.auth_section      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.auth_type         = password {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.cafile            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.certfile          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.collect_timing    = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.insecure          = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.keyfile           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.send_service_user_token = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.split_loggers     = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] service_user.timeout           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.agent_enabled            = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.enabled                  = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.html5proxy_port          = 6082 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.image_compression        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.jpeg_compression         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.playback_compression     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.server_listen            = 127.0.0.1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.streaming_mode           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] spice.zlib_compression         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] upgrade_levels.baseapi         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] upgrade_levels.cert            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] upgrade_levels.compute         = auto {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] upgrade_levels.conductor       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] upgrade_levels.scheduler       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vendordata_dynamic_auth.auth_section = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vendordata_dynamic_auth.auth_type = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vendordata_dynamic_auth.cafile = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vendordata_dynamic_auth.certfile = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vendordata_dynamic_auth.insecure = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vendordata_dynamic_auth.keyfile = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vendordata_dynamic_auth.timeout = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.api_retry_count         = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.ca_file                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.cache_prefix            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.cluster_name            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.connection_pool_size    = 10 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.console_delay_seconds   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.datastore_regex         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.host_ip                 = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.host_password           = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.host_port               = 443 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.host_username           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.insecure                = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.integration_bridge      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.maximum_objects         = 100 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.pbm_default_policy      = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.pbm_enabled             = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.pbm_wsdl_location       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.serial_port_proxy_uri   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.serial_port_service_uri = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.task_poll_interval      = 0.5 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.use_linked_clone        = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.vnc_keymap              = en-us {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.vnc_port                = 5900 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vmware.vnc_port_total          = 10000 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.auth_schemes               = ['none'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.enabled                    = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.novncproxy_port            = 6080 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.server_listen              = 0.0.0.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.vencrypt_ca_certs          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.vencrypt_client_cert       = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vnc.vencrypt_client_key        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.disable_rootwrap   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.enable_numa_live_migration = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.libvirt_disable_apic = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.client_socket_timeout     = 900 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.default_pool_size         = 1000 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.keep_alive                = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.max_header_line           = 16384 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.ssl_ca_file               = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.ssl_cert_file             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.ssl_key_file              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.tcp_keepidle              = 600 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] zvm.ca_file                    = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] zvm.cloud_connector_url        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] zvm.reachable_timeout          = 300 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.enforce_new_defaults = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.enforce_scope      = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.policy_default_rule = default {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.policy_file        = policy.yaml {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.connection_string     = messaging:// {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.enabled               = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.es_doc_type           = notification {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.es_scroll_size        = 10000 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.es_scroll_time        = 2m {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.filter_error_trace    = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.hmac_keys             = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.sentinel_service_name = mymaster {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.socket_timeout        = 0.1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.trace_requests        = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler.trace_sqlalchemy      = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler_jaeger.process_tags   = {} {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler_jaeger.service_name_prefix = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] profiler_otlp.service_name_prefix = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] remote_debug.host              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] remote_debug.port              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.ssl      = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_notifications.retry = -1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_messaging_notifications.transport_url = **** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.auth_section        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.auth_type           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.cafile              = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.certfile            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.collect_timing      = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.connect_retries     = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.connect_retry_delay = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.endpoint_id         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.endpoint_override   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.insecure            = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.keyfile             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.max_version         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.min_version         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.region_name         = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.service_name        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.service_type        = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.split_loggers       = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.status_code_retries = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.status_code_retry_delay = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.timeout             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.valid_interfaces    = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_limit.version             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_reports.file_event_handler = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] oslo_reports.log_dir           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_ovs_privileged.group  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] vif_plug_ovs_privileged.user   = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_linux_bridge.flat_interface = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_ovs.isolate_vif         = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_vif_ovs.per_port_bridge     = False {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] os_brick.lock_path             = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] privsep_osbrick.capabilities   = [21] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] privsep_osbrick.group          = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] privsep_osbrick.helper_command = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] privsep_osbrick.user           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] nova_sys_admin.group           = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] nova_sys_admin.helper_command  = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] nova_sys_admin.user            = None {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG oslo_service.service [None req-764c2a6b-eb23-4a69-aabe-7093795a280d None None] ******************************************************************************** {{(pid=73012) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 14 12:01:18 user nova-compute[73012]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 14 12:01:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Starting native event thread {{(pid=73012) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Starting green dispatch thread {{(pid=73012) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Starting connection event dispatch thread {{(pid=73012) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Connecting to libvirt: qemu:///system {{(pid=73012) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9af48bcd30> {{(pid=73012) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 14 12:01:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9af48bcd30> {{(pid=73012) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 14 12:01:18 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Connection event '1' reason 'None'
Aug 14 12:01:18 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 12:01:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.mount [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Initialising _HostMountState generation 0 {{(pid=73012) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 14 12:01:25 user nova-compute[73012]: INFO nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt host capabilities <capabilities>
Aug 14 12:01:25 user nova-compute[73012]:   <host>
Aug 14 12:01:25 user nova-compute[73012]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 14 12:01:25 user nova-compute[73012]:     <cpu>
Aug 14 12:01:25 user nova-compute[73012]:       <arch>x86_64</arch>
Aug 14 12:01:25 user nova-compute[73012]:       <model>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <vendor>Intel</vendor>
Aug 14 12:01:25 user nova-compute[73012]:       <microcode version='1070'/>
Aug 14 12:01:25 user nova-compute[73012]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 14 12:01:25 user nova-compute[73012]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='ss'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='vmx'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='pcid'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='osxsave'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='hypervisor'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='arat'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='tsc_adjust'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='md-clear'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='arch-capabilities'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='invtsc'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='rsba'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature name='skip-l1dfl-vmentry'/>
Aug 14 12:01:25 user nova-compute[73012]:       <pages unit='KiB' size='4'/>
Aug 14 12:01:25 user nova-compute[73012]:       <pages unit='KiB' size='2048'/>
Aug 14 12:01:25 user nova-compute[73012]:     </cpu>
Aug 14 12:01:25 user nova-compute[73012]:     <power_management>
Aug 14 12:01:25 user nova-compute[73012]:       <suspend_mem/>
Aug 14 12:01:25 user nova-compute[73012]:       <suspend_disk/>
Aug 14 12:01:25 user nova-compute[73012]:       <suspend_hybrid/>
Aug 14 12:01:25 user nova-compute[73012]:     </power_management>
Aug 14 12:01:25 user nova-compute[73012]:     <iommu support='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     <migration_features>
Aug 14 12:01:25 user nova-compute[73012]:       <live/>
Aug 14 12:01:25 user nova-compute[73012]:       <uri_transports>
Aug 14 12:01:25 user nova-compute[73012]:         <uri_transport>tcp</uri_transport>
Aug 14 12:01:25 user nova-compute[73012]:         <uri_transport>rdma</uri_transport>
Aug 14 12:01:25 user nova-compute[73012]:       </uri_transports>
Aug 14 12:01:25 user nova-compute[73012]:     </migration_features>
Aug 14 12:01:25 user nova-compute[73012]:     <topology>
Aug 14 12:01:25 user nova-compute[73012]:       <cells num='2'>
Aug 14 12:01:25 user nova-compute[73012]:         <cell id='0'>
Aug 14 12:01:25 user nova-compute[73012]:           <memory unit='KiB'>8140616</memory>
Aug 14 12:01:25 user nova-compute[73012]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 14 12:01:25 user nova-compute[73012]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 12:01:25 user nova-compute[73012]:           <distances>
Aug 14 12:01:25 user nova-compute[73012]:             <sibling id='0' value='10'/>
Aug 14 12:01:25 user nova-compute[73012]:             <sibling id='1' value='20'/>
Aug 14 12:01:25 user nova-compute[73012]:           </distances>
Aug 14 12:01:25 user nova-compute[73012]:           <cpus num='6'>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 14 12:01:25 user nova-compute[73012]:           </cpus>
Aug 14 12:01:25 user nova-compute[73012]:         </cell>
Aug 14 12:01:25 user nova-compute[73012]:         <cell id='1'>
Aug 14 12:01:25 user nova-compute[73012]:           <memory unit='KiB'>8255100</memory>
Aug 14 12:01:25 user nova-compute[73012]:           <pages unit='KiB' size='4'>2063775</pages>
Aug 14 12:01:25 user nova-compute[73012]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 12:01:25 user nova-compute[73012]:           <distances>
Aug 14 12:01:25 user nova-compute[73012]:             <sibling id='0' value='20'/>
Aug 14 12:01:25 user nova-compute[73012]:             <sibling id='1' value='10'/>
Aug 14 12:01:25 user nova-compute[73012]:           </distances>
Aug 14 12:01:25 user nova-compute[73012]:           <cpus num='6'>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 14 12:01:25 user nova-compute[73012]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 14 12:01:25 user nova-compute[73012]:           </cpus>
Aug 14 12:01:25 user nova-compute[73012]:         </cell>
Aug 14 12:01:25 user nova-compute[73012]:       </cells>
Aug 14 12:01:25 user nova-compute[73012]:     </topology>
Aug 14 12:01:25 user nova-compute[73012]:     <cache>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 14 12:01:25 user nova-compute[73012]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 14 12:01:25 user nova-compute[73012]:     </cache>
Aug 14 12:01:25 user nova-compute[73012]:     <secmodel>
Aug 14 12:01:25 user nova-compute[73012]:       <model>apparmor</model>
Aug 14 12:01:25 user nova-compute[73012]:       <doi>0</doi>
Aug 14 12:01:25 user nova-compute[73012]:     </secmodel>
Aug 14 12:01:25 user nova-compute[73012]:     <secmodel>
Aug 14 12:01:25 user nova-compute[73012]:       <model>dac</model>
Aug 14 12:01:25 user nova-compute[73012]:       <doi>0</doi>
Aug 14 12:01:25 user nova-compute[73012]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 14 12:01:25 user nova-compute[73012]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 14 12:01:25 user nova-compute[73012]:     </secmodel>
Aug 14 12:01:25 user nova-compute[73012]:   </host>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='alpha'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>clipper</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='armv6l'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>spitz</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>nuri</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>kzm</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sx1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>z2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>tosa</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>n810</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>n800</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>terrier</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>midway</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>microbit</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>verdex</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>highbank</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>akita</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>connex</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>collie</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='armv7l'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>spitz</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>nuri</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>kzm</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sx1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>z2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>tosa</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>n810</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>n800</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>terrier</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>midway</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>microbit</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>verdex</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>highbank</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>akita</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>connex</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>collie</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='aarch64'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>spitz</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>nuri</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>kzm</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sx1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>z2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>tosa</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>n810</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>n800</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>terrier</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>midway</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>microbit</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>verdex</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>raspi3b</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>highbank</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>akita</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>connex</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>collie</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <acpi default='on' toggle='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='cris'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='i686'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>isapc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>microvm</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='kvm'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <pae/>
Aug 14 12:01:25 user nova-compute[73012]:       <nonpae/>
Aug 14 12:01:25 user nova-compute[73012]:       <acpi default='on' toggle='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:       <apic default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='m68k'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>an5206</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>q800</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>next-cube</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='microblaze'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='microblazeel'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='mips'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='16'>malta</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='mipsel'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='16'>malta</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='mips64'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='16'>malta</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>pica61</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>magnum</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='mips64el'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='16'>malta</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>pica61</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>magnum</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='16'>boston</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='ppc'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mac99</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>40p</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>taihu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='ppc64'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>taihu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>40p</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mac99</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='ppc64le'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>taihu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>40p</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>mac99</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='riscv32'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='8'>spike</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>opentitan</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='8'>virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='riscv64'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='8'>spike</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>shakti_c</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='8'>virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='s390x'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='sh4'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>shix</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>r2d</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='sh4eb'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>shix</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>r2d</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='sparc'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>SS-5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>SS-20</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>LX</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>SS-4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>SS-10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>Voyager</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='sparc64'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sun4u</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>niagara</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>sun4v</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='x86_64'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>64</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='1'>isapc</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>microvm</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='kvm'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <acpi default='on' toggle='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:       <apic default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='xtensa'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>sim</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>kc705</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>ml605</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>lx200</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>lx60</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]:   <guest>
Aug 14 12:01:25 user nova-compute[73012]:     <os_type>hvm</os_type>
Aug 14 12:01:25 user nova-compute[73012]:     <arch name='xtensaeb'>
Aug 14 12:01:25 user nova-compute[73012]:       <wordsize>32</wordsize>
Aug 14 12:01:25 user nova-compute[73012]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='4'>sim</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>kc705</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>ml605</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>virt</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>lx200</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>lx60</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 12:01:25 user nova-compute[73012]:       <domain type='qemu'/>
Aug 14 12:01:25 user nova-compute[73012]:     </arch>
Aug 14 12:01:25 user nova-compute[73012]:     <features>
Aug 14 12:01:25 user nova-compute[73012]:       <cpuselection/>
Aug 14 12:01:25 user nova-compute[73012]:       <deviceboot/>
Aug 14 12:01:25 user nova-compute[73012]:       <disksnapshot default='on' toggle='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     </features>
Aug 14 12:01:25 user nova-compute[73012]:   </guest>
Aug 14 12:01:25 user nova-compute[73012]: </capabilities>
Aug 14 12:01:25 user nova-compute[73012]: 
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 14 12:01:25 user nova-compute[73012]: <domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 12:01:25 user nova-compute[73012]:   <domain>kvm</domain>
Aug 14 12:01:25 user nova-compute[73012]:   <machine>pc-q35-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:   <arch>i686</arch>
Aug 14 12:01:25 user nova-compute[73012]:   <vcpu max='288'/>
Aug 14 12:01:25 user nova-compute[73012]:   <iothreads supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:   <os supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='firmware'/>
Aug 14 12:01:25 user nova-compute[73012]:     <loader supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>rom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pflash</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='readonly'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='secure'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </loader>
Aug 14 12:01:25 user nova-compute[73012]:   </os>
Aug 14 12:01:25 user nova-compute[73012]:   <cpu>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-passthrough' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='hostPassthroughMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='maximum' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='maximumMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-model' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <vendor>Intel</vendor>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ss'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='vmx'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pcid'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='hypervisor'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arat'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='umip'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='md-clear'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibpb'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibrs'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='erms'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='lm'/>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='custom' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>qemu64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>qemu32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>phenom</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>n270</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>kvm64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>coreduo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>core2duo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>athlon</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Westmere</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Snowridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Penryn</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G5</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G4</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G1</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Nehalem</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Rome</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Milan</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Dhyana</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cooperlake</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Conroe</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>486</model>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:   </cpu>
Aug 14 12:01:25 user nova-compute[73012]:   <memoryBacking supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='sourceType'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>file</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>anonymous</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>memfd</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:   </memoryBacking>
Aug 14 12:01:25 user nova-compute[73012]:   <devices>
Aug 14 12:01:25 user nova-compute[73012]:     <disk supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='diskDevice'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>disk</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cdrom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>floppy</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>lun</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='bus'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>fdc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sata</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </disk>
Aug 14 12:01:25 user nova-compute[73012]:     <graphics supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sdl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vnc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>spice</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egl-headless</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </graphics>
Aug 14 12:01:25 user nova-compute[73012]:     <video supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='modelType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cirrus</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vmvga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>qxl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>none</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>bochs</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ramfb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </video>
Aug 14 12:01:25 user nova-compute[73012]:     <hostdev supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='mode'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>subsystem</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='startupPolicy'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>default</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>mandatory</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>requisite</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>optional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='subsysType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pci</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='capsType'/>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='pciBackend'/>
Aug 14 12:01:25 user nova-compute[73012]:     </hostdev>
Aug 14 12:01:25 user nova-compute[73012]:     <rng supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>random</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egd</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>builtin</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </rng>
Aug 14 12:01:25 user nova-compute[73012]:     <filesystem supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='driverType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>path</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>handle</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtiofs</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </filesystem>
Aug 14 12:01:25 user nova-compute[73012]:     <tpm supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-tis</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-crb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>passthrough</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>emulator</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </tpm>
Aug 14 12:01:25 user nova-compute[73012]:   </devices>
Aug 14 12:01:25 user nova-compute[73012]:   <features>
Aug 14 12:01:25 user nova-compute[73012]:     <gic supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     <vmcoreinfo supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <genid supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backingStoreInput supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backup supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <sev supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:   </features>
Aug 14 12:01:25 user nova-compute[73012]: </domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:  {{(pid=73012) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 14 12:01:25 user nova-compute[73012]: <domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 12:01:25 user nova-compute[73012]:   <domain>kvm</domain>
Aug 14 12:01:25 user nova-compute[73012]:   <machine>pc-q35-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:   <arch>i686</arch>
Aug 14 12:01:25 user nova-compute[73012]:   <vcpu max='288'/>
Aug 14 12:01:25 user nova-compute[73012]:   <iothreads supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:   <os supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='firmware'/>
Aug 14 12:01:25 user nova-compute[73012]:     <loader supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>rom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pflash</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='readonly'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='secure'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </loader>
Aug 14 12:01:25 user nova-compute[73012]:   </os>
Aug 14 12:01:25 user nova-compute[73012]:   <cpu>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-passthrough' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='hostPassthroughMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='maximum' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='maximumMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-model' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <vendor>Intel</vendor>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ss'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='vmx'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pcid'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='hypervisor'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arat'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='umip'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='md-clear'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibpb'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibrs'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='erms'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='lm'/>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='custom' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>qemu64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>qemu32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>phenom</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>n270</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>kvm64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>coreduo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>core2duo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>athlon</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Westmere</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Snowridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Penryn</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G5</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G4</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G1</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Nehalem</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Rome</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Milan</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Dhyana</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cooperlake</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Conroe</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>486</model>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:   </cpu>
Aug 14 12:01:25 user nova-compute[73012]:   <memoryBacking supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='sourceType'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>file</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>anonymous</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>memfd</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:   </memoryBacking>
Aug 14 12:01:25 user nova-compute[73012]:   <devices>
Aug 14 12:01:25 user nova-compute[73012]:     <disk supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='diskDevice'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>disk</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cdrom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>floppy</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>lun</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='bus'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>fdc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sata</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </disk>
Aug 14 12:01:25 user nova-compute[73012]:     <graphics supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sdl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vnc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>spice</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egl-headless</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </graphics>
Aug 14 12:01:25 user nova-compute[73012]:     <video supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='modelType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cirrus</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vmvga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>qxl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>none</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>bochs</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ramfb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </video>
Aug 14 12:01:25 user nova-compute[73012]:     <hostdev supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='mode'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>subsystem</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='startupPolicy'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>default</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>mandatory</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>requisite</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>optional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='subsysType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pci</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='capsType'/>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='pciBackend'/>
Aug 14 12:01:25 user nova-compute[73012]:     </hostdev>
Aug 14 12:01:25 user nova-compute[73012]:     <rng supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>random</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egd</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>builtin</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </rng>
Aug 14 12:01:25 user nova-compute[73012]:     <filesystem supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='driverType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>path</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>handle</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtiofs</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </filesystem>
Aug 14 12:01:25 user nova-compute[73012]:     <tpm supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-tis</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-crb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>passthrough</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>emulator</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </tpm>
Aug 14 12:01:25 user nova-compute[73012]:   </devices>
Aug 14 12:01:25 user nova-compute[73012]:   <features>
Aug 14 12:01:25 user nova-compute[73012]:     <gic supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     <vmcoreinfo supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <genid supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backingStoreInput supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backup supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <sev supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:   </features>
Aug 14 12:01:25 user nova-compute[73012]: </domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:  {{(pid=73012) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 14 12:01:25 user nova-compute[73012]: <domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 12:01:25 user nova-compute[73012]:   <domain>kvm</domain>
Aug 14 12:01:25 user nova-compute[73012]:   <machine>pc-i440fx-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:   <arch>i686</arch>
Aug 14 12:01:25 user nova-compute[73012]:   <vcpu max='255'/>
Aug 14 12:01:25 user nova-compute[73012]:   <iothreads supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:   <os supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='firmware'/>
Aug 14 12:01:25 user nova-compute[73012]:     <loader supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>rom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pflash</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='readonly'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='secure'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </loader>
Aug 14 12:01:25 user nova-compute[73012]:   </os>
Aug 14 12:01:25 user nova-compute[73012]:   <cpu>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-passthrough' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='hostPassthroughMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='maximum' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='maximumMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-model' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <vendor>Intel</vendor>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ss'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='vmx'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pcid'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='hypervisor'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arat'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='umip'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='md-clear'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibpb'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibrs'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='erms'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='lm'/>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='custom' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>qemu64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>qemu32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>phenom</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>n270</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>kvm64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>coreduo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>core2duo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>athlon</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Westmere</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Snowridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Penryn</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G5</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G4</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G1</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Nehalem</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Rome</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Milan</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Dhyana</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cooperlake</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Conroe</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>486</model>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:   </cpu>
Aug 14 12:01:25 user nova-compute[73012]:   <memoryBacking supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='sourceType'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>file</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>anonymous</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>memfd</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:   </memoryBacking>
Aug 14 12:01:25 user nova-compute[73012]:   <devices>
Aug 14 12:01:25 user nova-compute[73012]:     <disk supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='diskDevice'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>disk</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cdrom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>floppy</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>lun</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='bus'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ide</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>fdc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sata</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </disk>
Aug 14 12:01:25 user nova-compute[73012]:     <graphics supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sdl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vnc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>spice</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egl-headless</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </graphics>
Aug 14 12:01:25 user nova-compute[73012]:     <video supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='modelType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cirrus</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vmvga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>qxl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>none</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>bochs</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ramfb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </video>
Aug 14 12:01:25 user nova-compute[73012]:     <hostdev supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='mode'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>subsystem</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='startupPolicy'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>default</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>mandatory</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>requisite</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>optional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='subsysType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pci</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='capsType'/>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='pciBackend'/>
Aug 14 12:01:25 user nova-compute[73012]:     </hostdev>
Aug 14 12:01:25 user nova-compute[73012]:     <rng supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>random</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egd</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>builtin</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </rng>
Aug 14 12:01:25 user nova-compute[73012]:     <filesystem supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='driverType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>path</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>handle</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtiofs</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </filesystem>
Aug 14 12:01:25 user nova-compute[73012]:     <tpm supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-tis</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-crb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>passthrough</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>emulator</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </tpm>
Aug 14 12:01:25 user nova-compute[73012]:   </devices>
Aug 14 12:01:25 user nova-compute[73012]:   <features>
Aug 14 12:01:25 user nova-compute[73012]:     <gic supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     <vmcoreinfo supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <genid supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backingStoreInput supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backup supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <sev supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:   </features>
Aug 14 12:01:25 user nova-compute[73012]: </domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:  {{(pid=73012) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 14 12:01:25 user nova-compute[73012]: <domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 12:01:25 user nova-compute[73012]:   <domain>kvm</domain>
Aug 14 12:01:25 user nova-compute[73012]:   <machine>pc-i440fx-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:   <arch>i686</arch>
Aug 14 12:01:25 user nova-compute[73012]:   <vcpu max='255'/>
Aug 14 12:01:25 user nova-compute[73012]:   <iothreads supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:   <os supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='firmware'/>
Aug 14 12:01:25 user nova-compute[73012]:     <loader supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>rom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pflash</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='readonly'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='secure'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </loader>
Aug 14 12:01:25 user nova-compute[73012]:   </os>
Aug 14 12:01:25 user nova-compute[73012]:   <cpu>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-passthrough' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='hostPassthroughMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='maximum' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='maximumMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-model' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <vendor>Intel</vendor>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ss'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='vmx'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pcid'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='hypervisor'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arat'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='umip'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='md-clear'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibpb'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibrs'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='erms'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='lm'/>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='custom' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>qemu64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>qemu32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>phenom</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>n270</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>kvm64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>coreduo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>core2duo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>athlon</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Westmere</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Snowridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Penryn</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G5</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G4</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G1</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Nehalem</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Rome</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Milan</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Dhyana</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cooperlake</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Conroe</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>486</model>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:   </cpu>
Aug 14 12:01:25 user nova-compute[73012]:   <memoryBacking supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='sourceType'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>file</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>anonymous</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>memfd</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:   </memoryBacking>
Aug 14 12:01:25 user nova-compute[73012]:   <devices>
Aug 14 12:01:25 user nova-compute[73012]:     <disk supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='diskDevice'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>disk</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cdrom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>floppy</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>lun</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='bus'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ide</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>fdc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sata</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </disk>
Aug 14 12:01:25 user nova-compute[73012]:     <graphics supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sdl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vnc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>spice</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egl-headless</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </graphics>
Aug 14 12:01:25 user nova-compute[73012]:     <video supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='modelType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cirrus</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vmvga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>qxl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>none</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>bochs</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ramfb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </video>
Aug 14 12:01:25 user nova-compute[73012]:     <hostdev supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='mode'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>subsystem</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='startupPolicy'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>default</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>mandatory</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>requisite</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>optional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='subsysType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pci</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='capsType'/>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='pciBackend'/>
Aug 14 12:01:25 user nova-compute[73012]:     </hostdev>
Aug 14 12:01:25 user nova-compute[73012]:     <rng supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>random</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egd</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>builtin</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </rng>
Aug 14 12:01:25 user nova-compute[73012]:     <filesystem supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='driverType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>path</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>handle</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtiofs</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </filesystem>
Aug 14 12:01:25 user nova-compute[73012]:     <tpm supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-tis</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-crb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>passthrough</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>emulator</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </tpm>
Aug 14 12:01:25 user nova-compute[73012]:   </devices>
Aug 14 12:01:25 user nova-compute[73012]:   <features>
Aug 14 12:01:25 user nova-compute[73012]:     <gic supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     <vmcoreinfo supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <genid supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backingStoreInput supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backup supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <sev supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:   </features>
Aug 14 12:01:25 user nova-compute[73012]: </domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:  {{(pid=73012) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 14 12:01:25 user nova-compute[73012]: <domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 12:01:25 user nova-compute[73012]:   <domain>kvm</domain>
Aug 14 12:01:25 user nova-compute[73012]:   <machine>pc-q35-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:   <arch>x86_64</arch>
Aug 14 12:01:25 user nova-compute[73012]:   <vcpu max='288'/>
Aug 14 12:01:25 user nova-compute[73012]:   <iothreads supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:   <os supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='firmware'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>efi</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:     <loader supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>rom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pflash</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='readonly'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='secure'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </loader>
Aug 14 12:01:25 user nova-compute[73012]:   </os>
Aug 14 12:01:25 user nova-compute[73012]:   <cpu>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-passthrough' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='hostPassthroughMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='maximum' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='maximumMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-model' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <vendor>Intel</vendor>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ss'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='vmx'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pcid'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='hypervisor'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arat'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='umip'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='md-clear'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='invtsc'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibpb'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibrs'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='rsba'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='erms'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='custom' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>qemu64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>qemu32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>phenom</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>n270</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>coreduo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>core2duo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>athlon</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Westmere</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Snowridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Penryn</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G5</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G4</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Opteron_G1</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Nehalem</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Rome</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Milan</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Dhyana</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cooperlake</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Conroe</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>486</model>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:   </cpu>
Aug 14 12:01:25 user nova-compute[73012]:   <memoryBacking supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='sourceType'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>file</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>anonymous</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>memfd</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:   </memoryBacking>
Aug 14 12:01:25 user nova-compute[73012]:   <devices>
Aug 14 12:01:25 user nova-compute[73012]:     <disk supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='diskDevice'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>disk</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cdrom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>floppy</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>lun</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='bus'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>fdc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sata</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </disk>
Aug 14 12:01:25 user nova-compute[73012]:     <graphics supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sdl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vnc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>spice</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egl-headless</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </graphics>
Aug 14 12:01:25 user nova-compute[73012]:     <video supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='modelType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cirrus</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vmvga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>qxl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>none</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>bochs</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ramfb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </video>
Aug 14 12:01:25 user nova-compute[73012]:     <hostdev supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='mode'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>subsystem</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='startupPolicy'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>default</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>mandatory</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>requisite</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>optional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='subsysType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pci</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='capsType'/>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='pciBackend'/>
Aug 14 12:01:25 user nova-compute[73012]:     </hostdev>
Aug 14 12:01:25 user nova-compute[73012]:     <rng supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>random</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egd</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>builtin</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </rng>
Aug 14 12:01:25 user nova-compute[73012]:     <filesystem supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='driverType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>path</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>handle</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtiofs</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </filesystem>
Aug 14 12:01:25 user nova-compute[73012]:     <tpm supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-tis</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-crb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>passthrough</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>emulator</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </tpm>
Aug 14 12:01:25 user nova-compute[73012]:   </devices>
Aug 14 12:01:25 user nova-compute[73012]:   <features>
Aug 14 12:01:25 user nova-compute[73012]:     <gic supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     <vmcoreinfo supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <genid supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backingStoreInput supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backup supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <sev supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:   </features>
Aug 14 12:01:25 user nova-compute[73012]: </domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:  {{(pid=73012) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 14 12:01:25 user nova-compute[73012]: <domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 12:01:25 user nova-compute[73012]:   <domain>kvm</domain>
Aug 14 12:01:25 user nova-compute[73012]:   <machine>pc-q35-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:   <arch>x86_64</arch>
Aug 14 12:01:25 user nova-compute[73012]:   <vcpu max='288'/>
Aug 14 12:01:25 user nova-compute[73012]:   <iothreads supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:   <os supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='firmware'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>efi</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:     <loader supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>rom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pflash</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='readonly'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='secure'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </loader>
Aug 14 12:01:25 user nova-compute[73012]:   </os>
Aug 14 12:01:25 user nova-compute[73012]:   <cpu>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-passthrough' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='hostPassthroughMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='maximum' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='maximumMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-model' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <vendor>Intel</vendor>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ss'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='vmx'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pcid'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='hypervisor'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arat'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='umip'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='md-clear'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='invtsc'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibpb'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibrs'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='rsba'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='erms'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='custom' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>qemu64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>qemu32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>phenom</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>n270</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>coreduo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>core2duo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>athlon</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Westmere</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Snowridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Penryn</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G5</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G4</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Opteron_G1</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Nehalem</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Rome</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Milan</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Dhyana</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cooperlake</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Conroe</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>486</model>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:   </cpu>
Aug 14 12:01:25 user nova-compute[73012]:   <memoryBacking supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='sourceType'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>file</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>anonymous</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>memfd</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:   </memoryBacking>
Aug 14 12:01:25 user nova-compute[73012]:   <devices>
Aug 14 12:01:25 user nova-compute[73012]:     <disk supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='diskDevice'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>disk</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cdrom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>floppy</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>lun</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='bus'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>fdc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sata</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </disk>
Aug 14 12:01:25 user nova-compute[73012]:     <graphics supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sdl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vnc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>spice</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egl-headless</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </graphics>
Aug 14 12:01:25 user nova-compute[73012]:     <video supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='modelType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cirrus</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vmvga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>qxl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>none</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>bochs</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ramfb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </video>
Aug 14 12:01:25 user nova-compute[73012]:     <hostdev supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='mode'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>subsystem</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='startupPolicy'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>default</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>mandatory</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>requisite</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>optional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='subsysType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pci</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='capsType'/>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='pciBackend'/>
Aug 14 12:01:25 user nova-compute[73012]:     </hostdev>
Aug 14 12:01:25 user nova-compute[73012]:     <rng supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>random</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egd</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>builtin</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </rng>
Aug 14 12:01:25 user nova-compute[73012]:     <filesystem supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='driverType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>path</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>handle</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtiofs</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </filesystem>
Aug 14 12:01:25 user nova-compute[73012]:     <tpm supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-tis</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-crb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>passthrough</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>emulator</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </tpm>
Aug 14 12:01:25 user nova-compute[73012]:   </devices>
Aug 14 12:01:25 user nova-compute[73012]:   <features>
Aug 14 12:01:25 user nova-compute[73012]:     <gic supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     <vmcoreinfo supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <genid supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backingStoreInput supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backup supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <sev supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:   </features>
Aug 14 12:01:25 user nova-compute[73012]: </domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:  {{(pid=73012) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 14 12:01:25 user nova-compute[73012]: <domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 12:01:25 user nova-compute[73012]:   <domain>kvm</domain>
Aug 14 12:01:25 user nova-compute[73012]:   <machine>pc-i440fx-jammy</machine>
Aug 14 12:01:25 user nova-compute[73012]:   <arch>x86_64</arch>
Aug 14 12:01:25 user nova-compute[73012]:   <vcpu max='255'/>
Aug 14 12:01:25 user nova-compute[73012]:   <iothreads supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:   <os supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='firmware'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>efi</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:     <loader supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>rom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pflash</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='readonly'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='secure'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </loader>
Aug 14 12:01:25 user nova-compute[73012]:   </os>
Aug 14 12:01:25 user nova-compute[73012]:   <cpu>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-passthrough' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='hostPassthroughMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='maximum' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='maximumMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-model' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <vendor>Intel</vendor>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ss'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='vmx'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pcid'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='hypervisor'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arat'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='umip'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='md-clear'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='invtsc'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibpb'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibrs'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='rsba'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='erms'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='custom' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>qemu64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>qemu32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>phenom</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>n270</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>coreduo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>core2duo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>athlon</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Westmere</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Snowridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Penryn</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G5</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G4</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Opteron_G1</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Nehalem</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Rome</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Milan</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Dhyana</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cooperlake</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Conroe</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>486</model>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:   </cpu>
Aug 14 12:01:25 user nova-compute[73012]:   <memoryBacking supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='sourceType'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>file</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>anonymous</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>memfd</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:   </memoryBacking>
Aug 14 12:01:25 user nova-compute[73012]:   <devices>
Aug 14 12:01:25 user nova-compute[73012]:     <disk supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='diskDevice'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>disk</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cdrom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>floppy</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>lun</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='bus'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ide</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>fdc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sata</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </disk>
Aug 14 12:01:25 user nova-compute[73012]:     <graphics supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sdl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vnc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>spice</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egl-headless</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </graphics>
Aug 14 12:01:25 user nova-compute[73012]:     <video supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='modelType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cirrus</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vmvga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>qxl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>none</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>bochs</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ramfb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </video>
Aug 14 12:01:25 user nova-compute[73012]:     <hostdev supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='mode'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>subsystem</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='startupPolicy'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>default</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>mandatory</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>requisite</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>optional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='subsysType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pci</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='capsType'/>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='pciBackend'/>
Aug 14 12:01:25 user nova-compute[73012]:     </hostdev>
Aug 14 12:01:25 user nova-compute[73012]:     <rng supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>random</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egd</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>builtin</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </rng>
Aug 14 12:01:25 user nova-compute[73012]:     <filesystem supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='driverType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>path</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>handle</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtiofs</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </filesystem>
Aug 14 12:01:25 user nova-compute[73012]:     <tpm supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-tis</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-crb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>passthrough</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>emulator</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </tpm>
Aug 14 12:01:25 user nova-compute[73012]:   </devices>
Aug 14 12:01:25 user nova-compute[73012]:   <features>
Aug 14 12:01:25 user nova-compute[73012]:     <gic supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     <vmcoreinfo supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <genid supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backingStoreInput supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backup supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <sev supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:   </features>
Aug 14 12:01:25 user nova-compute[73012]: </domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:  {{(pid=73012) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 14 12:01:25 user nova-compute[73012]: <domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 12:01:25 user nova-compute[73012]:   <domain>kvm</domain>
Aug 14 12:01:25 user nova-compute[73012]:   <machine>pc-i440fx-6.2</machine>
Aug 14 12:01:25 user nova-compute[73012]:   <arch>x86_64</arch>
Aug 14 12:01:25 user nova-compute[73012]:   <vcpu max='255'/>
Aug 14 12:01:25 user nova-compute[73012]:   <iothreads supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:   <os supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='firmware'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>efi</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:     <loader supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>rom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pflash</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='readonly'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>yes</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='secure'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>no</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </loader>
Aug 14 12:01:25 user nova-compute[73012]:   </os>
Aug 14 12:01:25 user nova-compute[73012]:   <cpu>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-passthrough' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='hostPassthroughMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='maximum' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='maximumMigratable'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>on</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>off</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='host-model' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <vendor>Intel</vendor>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ss'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='vmx'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pcid'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='hypervisor'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arat'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='umip'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='md-clear'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='invtsc'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibpb'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='ibrs'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-stibp'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='rsba'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='erms'/>
Aug 14 12:01:25 user nova-compute[73012]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:     <mode name='custom' supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>qemu64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>qemu32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>phenom</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>pentium</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>n270</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm64</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>kvm32</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>coreduo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>core2duo</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>athlon</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Westmere</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Snowridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Skylake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>SandyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Penryn</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G5</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G4</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G3</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Opteron_G2</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Opteron_G1</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Nehalem</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>IvyBridge</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Icelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Haswell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Rome</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-Milan</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>EPYC</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Dhyana</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cooperlake</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>Conroe</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='no'>Broadwell</model>
Aug 14 12:01:25 user nova-compute[73012]:       <model usable='yes'>486</model>
Aug 14 12:01:25 user nova-compute[73012]:     </mode>
Aug 14 12:01:25 user nova-compute[73012]:   </cpu>
Aug 14 12:01:25 user nova-compute[73012]:   <memoryBacking supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:     <enum name='sourceType'>
Aug 14 12:01:25 user nova-compute[73012]:       <value>file</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>anonymous</value>
Aug 14 12:01:25 user nova-compute[73012]:       <value>memfd</value>
Aug 14 12:01:25 user nova-compute[73012]:     </enum>
Aug 14 12:01:25 user nova-compute[73012]:   </memoryBacking>
Aug 14 12:01:25 user nova-compute[73012]:   <devices>
Aug 14 12:01:25 user nova-compute[73012]:     <disk supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='diskDevice'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>disk</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cdrom</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>floppy</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>lun</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='bus'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ide</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>fdc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sata</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </disk>
Aug 14 12:01:25 user nova-compute[73012]:     <graphics supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='type'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>sdl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vnc</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>spice</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egl-headless</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </graphics>
Aug 14 12:01:25 user nova-compute[73012]:     <video supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='modelType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>cirrus</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>vmvga</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>qxl</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>none</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>bochs</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>ramfb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </video>
Aug 14 12:01:25 user nova-compute[73012]:     <hostdev supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='mode'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>subsystem</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='startupPolicy'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>default</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>mandatory</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>requisite</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>optional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='subsysType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>usb</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>pci</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>scsi</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='capsType'/>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='pciBackend'/>
Aug 14 12:01:25 user nova-compute[73012]:     </hostdev>
Aug 14 12:01:25 user nova-compute[73012]:     <rng supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtio-non-transitional</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>random</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>egd</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>builtin</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </rng>
Aug 14 12:01:25 user nova-compute[73012]:     <filesystem supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='driverType'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>path</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>handle</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>virtiofs</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </filesystem>
Aug 14 12:01:25 user nova-compute[73012]:     <tpm supported='yes'>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='model'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-tis</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>tpm-crb</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:       <enum name='backendModel'>
Aug 14 12:01:25 user nova-compute[73012]:         <value>passthrough</value>
Aug 14 12:01:25 user nova-compute[73012]:         <value>emulator</value>
Aug 14 12:01:25 user nova-compute[73012]:       </enum>
Aug 14 12:01:25 user nova-compute[73012]:     </tpm>
Aug 14 12:01:25 user nova-compute[73012]:   </devices>
Aug 14 12:01:25 user nova-compute[73012]:   <features>
Aug 14 12:01:25 user nova-compute[73012]:     <gic supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:     <vmcoreinfo supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <genid supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backingStoreInput supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <backup supported='yes'/>
Aug 14 12:01:25 user nova-compute[73012]:     <sev supported='no'/>
Aug 14 12:01:25 user nova-compute[73012]:   </features>
Aug 14 12:01:25 user nova-compute[73012]: </domainCapabilities>
Aug 14 12:01:25 user nova-compute[73012]:  {{(pid=73012) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73012) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73012) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Checking secure boot support for host arch (x86_64) {{(pid=73012) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 12:01:25 user nova-compute[73012]: INFO nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Secure Boot support detected
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] cpu compare xml: <cpu match="exact">
Aug 14 12:01:25 user nova-compute[73012]:   <model>Nehalem</model>
Aug 14 12:01:25 user nova-compute[73012]: </cpu>
Aug 14 12:01:25 user nova-compute[73012]:  {{(pid=73012) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 14 12:01:25 user nova-compute[73012]: INFO nova.virt.node [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Generated node identity 18c3368b-9ede-4a07-be2d-712c9b5eb568
Aug 14 12:01:25 user nova-compute[73012]: INFO nova.virt.node [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Wrote node identity 18c3368b-9ede-4a07-be2d-712c9b5eb568 to /opt/stack/data/nova/compute_id
Aug 14 12:01:25 user nova-compute[73012]: WARNING nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Compute nodes ['18c3368b-9ede-4a07-be2d-712c9b5eb568'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 14 12:01:25 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 14 12:01:25 user nova-compute[73012]: WARNING nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 12:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:01:25 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:01:26 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:01:26 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Hypervisor/Node resource view: name=user free_ram=10849MB free_disk=26.415454864501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:01:26 user nova-compute[73012]: WARNING nova.compute.resource_tracker [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] No compute node record for user:18c3368b-9ede-4a07-be2d-712c9b5eb568: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 18c3368b-9ede-4a07-be2d-712c9b5eb568 could not be found.
Aug 14 12:01:26 user nova-compute[73012]: INFO nova.compute.resource_tracker [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Compute node record created for user:user with uuid: 18c3368b-9ede-4a07-be2d-712c9b5eb568
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:01:26 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [req-c8567eb8-a139-4dbb-bdf8-857c398898cd] Created resource provider record via placement API for resource provider with UUID 18c3368b-9ede-4a07-be2d-712c9b5eb568 and name user.
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73012) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 14 12:01:26 user nova-compute[73012]: INFO nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] kernel doesn't support AMD SEV
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Libvirt baseline CPU <cpu>
Aug 14 12:01:26 user nova-compute[73012]:   <arch>x86_64</arch>
Aug 14 12:01:26 user nova-compute[73012]:   <model>Nehalem</model>
Aug 14 12:01:26 user nova-compute[73012]:   <vendor>Intel</vendor>
Aug 14 12:01:26 user nova-compute[73012]:   <topology sockets="6" cores="1" threads="1"/>
Aug 14 12:01:26 user nova-compute[73012]: </cpu>
Aug 14 12:01:26 user nova-compute[73012]:  {{(pid=73012) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Updated inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Updating resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 generation from 0 to 1 during operation: update_inventory {{(pid=73012) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Updating resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 generation from 1 to 2 during operation: update_traits {{(pid=73012) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.service [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Creating RPC server for service compute {{(pid=73012) start /opt/stack/nova/nova/service.py:182}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.service [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Join ServiceGroup membership for this service compute {{(pid=73012) start /opt/stack/nova/nova/service.py:199}}
Aug 14 12:01:26 user nova-compute[73012]: DEBUG nova.servicegroup.drivers.db [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73012) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:02:25 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:02:26 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:02:26 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:02:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=10255MB free_disk=26.31905746459961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:02:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:02:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:02:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:02:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:02:26 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:02:26 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:02:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:02:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:02:26 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:03:19 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:03:19 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:03:19 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=10188MB free_disk=26.365222930908203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:03:19 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:03:20 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:03:20 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:03:20 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:03:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:04:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:04:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:04:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:04:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:04:20 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:04:20 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:04:20 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=10169MB free_disk=26.14940643310547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:04:20 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:04:21 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:04:21 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:04:21 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:04:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:04:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:04:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:20 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:05:20 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:20 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:20 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=9439MB free_disk=26.171958923339844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:05:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:21 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:05:21 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:05:21 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:05:21 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:05:21 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:05:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:05:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:05:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:05:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:05:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:05:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.249s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:05:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:05:28 user nova-compute[73012]: INFO nova.compute.claims [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Claim successful on node user
Aug 14 12:05:28 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:05:28 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:05:29 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:05:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:05:29 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Creating image(s)
Aug 14 12:05:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "/opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "/opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:29 user nova-compute[73012]: DEBUG nova.policy [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7704699c47d4d288028fc5e872157a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acff498d08d64cd8850ee4cfe13b87ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:05:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061.part --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:30 user nova-compute[73012]: DEBUG nova.virt.images [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] f1c1bbe4-a191-4a75-9890-606d22f47ada was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:05:30 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:05:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061.part /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061.part /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061.converted" returned: 0 in 0.247s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.485s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:30 user nova-compute[73012]: INFO oslo.privsep.daemon [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp13jfaju4/privsep.sock']
Aug 14 12:05:30 user sudo[82278]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp13jfaju4/privsep.sock
Aug 14 12:05:30 user sudo[82278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 12:05:31 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Successfully created port: 408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:05:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:05:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:05:32 user nova-compute[73012]: INFO nova.compute.claims [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Claim successful on node user
Aug 14 12:05:32 user sudo[82278]: pam_unix(sudo:session): session closed for user root
Aug 14 12:05:32 user nova-compute[73012]: INFO oslo.privsep.daemon [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Spawned new privsep daemon via rootwrap
Aug 14 12:05:32 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 12:05:32 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 12:05:32 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 14 12:05:32 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82290
Aug 14 12:05:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:05:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.215s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk 1073741824" returned: 0 in 0.045s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:05:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Creating image(s)
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.policy [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7648caa38d8e4de6bf9751a512ffb14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b522100e4bf447e3b544983c451c3786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Successfully updated port: 408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "refresh_cache-9cca8a9c-127f-44ab-9acd-3ebc43323c6e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquired lock "refresh_cache-9cca8a9c-127f-44ab-9acd-3ebc43323c6e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Cannot resize image /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lazy-loading 'migration_context' on Instance uuid 9cca8a9c-127f-44ab-9acd-3ebc43323c6e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Ensure instance console log exists: /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk 1073741824" returned: 0 in 0.108s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-b6659d07-0d30-477d-b002-6e4745a27791 req-0002a360-539a-4d2f-9e5d-a5e7205512fa service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received event network-changed-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-b6659d07-0d30-477d-b002-6e4745a27791 req-0002a360-539a-4d2f-9e5d-a5e7205512fa service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Refreshing instance network info cache due to event network-changed-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b6659d07-0d30-477d-b002-6e4745a27791 req-0002a360-539a-4d2f-9e5d-a5e7205512fa service nova] Acquiring lock "refresh_cache-9cca8a9c-127f-44ab-9acd-3ebc43323c6e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:05:34 user nova-compute[73012]: INFO nova.compute.claims [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Claim successful on node user
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.218s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Cannot resize image /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.objects.instance [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'migration_context' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Ensure instance console log exists: /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Updating instance_info_cache with network_info: [{"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Releasing lock "refresh_cache-9cca8a9c-127f-44ab-9acd-3ebc43323c6e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Instance network_info: |[{"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b6659d07-0d30-477d-b002-6e4745a27791 req-0002a360-539a-4d2f-9e5d-a5e7205512fa service nova] Acquired lock "refresh_cache-9cca8a9c-127f-44ab-9acd-3ebc43323c6e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.network.neutron [req-b6659d07-0d30-477d-b002-6e4745a27791 req-0002a360-539a-4d2f-9e5d-a5e7205512fa service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Refreshing network info cache for port 408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Start _get_guest_xml network_info=[{"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:05:34 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:34 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-524219684',display_name='tempest-DeleteServersTestJSON-server-524219684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-524219684',id=1,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acff498d08d64cd8850ee4cfe13b87ab',ramdisk_id='',reservation_id='r-ec6trpjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-673020177',owner_user_name='tempest-DeleteServersTestJSON-673020177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:29Z,user_data=None,user_id='b7704699c47d4d288028fc5e872157a5',uuid=9cca8a9c-127f-44ab-9acd-3ebc43323c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Converting VIF {"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=408a3ec8-bdfc-463f-98c4-5bc8e4397b1c,network=Network(e45062b3-3db8-4280-8ae9-5f74a9f397ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap408a3ec8-bd') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cca8a9c-127f-44ab-9acd-3ebc43323c6e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:05:34 user nova-compute[73012]:   <uuid>9cca8a9c-127f-44ab-9acd-3ebc43323c6e</uuid>
Aug 14 12:05:34 user nova-compute[73012]:   <name>instance-00000001</name>
Aug 14 12:05:34 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:05:34 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:05:34 user nova-compute[73012]:   <metadata>
Aug 14 12:05:34 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:05:34 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:05:34 user nova-compute[73012]:       <nova:name>tempest-DeleteServersTestJSON-server-524219684</nova:name>
Aug 14 12:05:34 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:05:34</nova:creationTime>
Aug 14 12:05:34 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:05:34 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:05:34 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:05:34 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:05:34 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:05:34 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:05:34 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:05:34 user nova-compute[73012]:       <nova:owner>
Aug 14 12:05:34 user nova-compute[73012]:         <nova:user uuid="b7704699c47d4d288028fc5e872157a5">tempest-DeleteServersTestJSON-673020177-project-member</nova:user>
Aug 14 12:05:34 user nova-compute[73012]:         <nova:project uuid="acff498d08d64cd8850ee4cfe13b87ab">tempest-DeleteServersTestJSON-673020177</nova:project>
Aug 14 12:05:34 user nova-compute[73012]:       </nova:owner>
Aug 14 12:05:34 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:05:34 user nova-compute[73012]:       <nova:ports>
Aug 14 12:05:34 user nova-compute[73012]:         <nova:port uuid="408a3ec8-bdfc-463f-98c4-5bc8e4397b1c">
Aug 14 12:05:34 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 12:05:34 user nova-compute[73012]:         </nova:port>
Aug 14 12:05:34 user nova-compute[73012]:       </nova:ports>
Aug 14 12:05:34 user nova-compute[73012]:     </nova:instance>
Aug 14 12:05:34 user nova-compute[73012]:   </metadata>
Aug 14 12:05:34 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:05:34 user nova-compute[73012]:     <system>
Aug 14 12:05:34 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:05:34 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:05:34 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:05:34 user nova-compute[73012]:       <entry name="serial">9cca8a9c-127f-44ab-9acd-3ebc43323c6e</entry>
Aug 14 12:05:34 user nova-compute[73012]:       <entry name="uuid">9cca8a9c-127f-44ab-9acd-3ebc43323c6e</entry>
Aug 14 12:05:34 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:05:34 user nova-compute[73012]:     </system>
Aug 14 12:05:34 user nova-compute[73012]:   </sysinfo>
Aug 14 12:05:34 user nova-compute[73012]:   <os>
Aug 14 12:05:34 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:05:34 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:05:34 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:05:34 user nova-compute[73012]:   </os>
Aug 14 12:05:34 user nova-compute[73012]:   <features>
Aug 14 12:05:34 user nova-compute[73012]:     <acpi/>
Aug 14 12:05:34 user nova-compute[73012]:     <apic/>
Aug 14 12:05:34 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:05:34 user nova-compute[73012]:   </features>
Aug 14 12:05:34 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:05:34 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:05:34 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:05:34 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:05:34 user nova-compute[73012]:   </clock>
Aug 14 12:05:34 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:05:34 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:05:34 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:05:34 user nova-compute[73012]:   </cpu>
Aug 14 12:05:34 user nova-compute[73012]:   <devices>
Aug 14 12:05:34 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:05:34 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:05:34 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk"/>
Aug 14 12:05:34 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:05:34 user nova-compute[73012]:     </disk>
Aug 14 12:05:34 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:05:34 user nova-compute[73012]:       <mac address="fa:16:3e:01:1d:2d"/>
Aug 14 12:05:34 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:34 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:05:34 user nova-compute[73012]:       <target dev="tap408a3ec8-bd"/>
Aug 14 12:05:34 user nova-compute[73012]:     </interface>
Aug 14 12:05:34 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:05:34 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/console.log" append="off"/>
Aug 14 12:05:34 user nova-compute[73012]:     </serial>
Aug 14 12:05:34 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:05:34 user nova-compute[73012]:     <video>
Aug 14 12:05:34 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:34 user nova-compute[73012]:     </video>
Aug 14 12:05:34 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:05:34 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:05:34 user nova-compute[73012]:     </rng>
Aug 14 12:05:34 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:05:34 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:05:34 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:05:34 user nova-compute[73012]:     </memballoon>
Aug 14 12:05:34 user nova-compute[73012]:   </devices>
Aug 14 12:05:34 user nova-compute[73012]: </domain>
Aug 14 12:05:34 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-524219684',display_name='tempest-DeleteServersTestJSON-server-524219684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-524219684',id=1,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acff498d08d64cd8850ee4cfe13b87ab',ramdisk_id='',reservation_id='r-ec6trpjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-673020177',owner_user_name='tempest-DeleteServersTestJSON-673020177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:29Z,user_data=None,user_id='b7704699c47d4d288028fc5e872157a5',uuid=9cca8a9c-127f-44ab-9acd-3ebc43323c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Converting VIF {"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=408a3ec8-bdfc-463f-98c4-5bc8e4397b1c,network=Network(e45062b3-3db8-4280-8ae9-5f74a9f397ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap408a3ec8-bd') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG os_vif [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=408a3ec8-bdfc-463f-98c4-5bc8e4397b1c,network=Network(e45062b3-3db8-4280-8ae9-5f74a9f397ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap408a3ec8-bd') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:05:34 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Created schema index Interface.name {{(pid=73012) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Created schema index Port.name {{(pid=73012) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Created schema index Bridge.name {{(pid=73012) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [POLLOUT] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:05:34 user nova-compute[73012]: INFO oslo.privsep.daemon [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp15juhzxl/privsep.sock']
Aug 14 12:05:34 user sudo[82331]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp15juhzxl/privsep.sock
Aug 14 12:05:34 user sudo[82331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 12:05:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:05:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Creating image(s)
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG nova.policy [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e558a10b41b4c9a9c232742b5cd3564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0b3f5808324dc1994b2264b2a2a878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk 1073741824" returned: 0 in 0.055s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Cannot resize image /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'migration_context' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Ensure instance console log exists: /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:36 user nova-compute[73012]: DEBUG nova.network.neutron [req-b6659d07-0d30-477d-b002-6e4745a27791 req-0002a360-539a-4d2f-9e5d-a5e7205512fa service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Updated VIF entry in instance network info cache for port 408a3ec8-bdfc-463f-98c4-5bc8e4397b1c. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:05:36 user nova-compute[73012]: DEBUG nova.network.neutron [req-b6659d07-0d30-477d-b002-6e4745a27791 req-0002a360-539a-4d2f-9e5d-a5e7205512fa service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Updating instance_info_cache with network_info: [{"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b6659d07-0d30-477d-b002-6e4745a27791 req-0002a360-539a-4d2f-9e5d-a5e7205512fa service nova] Releasing lock "refresh_cache-9cca8a9c-127f-44ab-9acd-3ebc43323c6e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:36 user sudo[82331]: pam_unix(sudo:session): session closed for user root
Aug 14 12:05:36 user nova-compute[73012]: INFO oslo.privsep.daemon [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Spawned new privsep daemon via rootwrap
Aug 14 12:05:36 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 12:05:36 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 12:05:36 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 14 12:05:36 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82349
Aug 14 12:05:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap408a3ec8-bd, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap408a3ec8-bd, col_values=(('external_ids', {'iface-id': '408a3ec8-bdfc-463f-98c4-5bc8e4397b1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:1d:2d', 'vm-uuid': '9cca8a9c-127f-44ab-9acd-3ebc43323c6e'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:05:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:37 user nova-compute[73012]: INFO os_vif [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=408a3ec8-bdfc-463f-98c4-5bc8e4397b1c,network=Network(e45062b3-3db8-4280-8ae9-5f74a9f397ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap408a3ec8-bd')
Aug 14 12:05:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:05:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] No VIF found with MAC fa:16:3e:01:1d:2d, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:05:38 user nova-compute[73012]: DEBUG nova.network.neutron [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Successfully created port: b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:05:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:39 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Successfully created port: decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:05:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014740.791633, 9cca8a9c-127f-44ab-9acd-3ebc43323c6e => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:40 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] VM Resumed (Lifecycle Event)
Aug 14 12:05:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Instance spawned successfully.
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:40 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:05:40 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014740.7919333, 9cca8a9c-127f-44ab-9acd-3ebc43323c6e => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:40 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] VM Started (Lifecycle Event)
Aug 14 12:05:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:41 user nova-compute[73012]: INFO nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Took 11.61 seconds to spawn the instance on the hypervisor.
Aug 14 12:05:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:41 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:05:41 user nova-compute[73012]: INFO nova.compute.manager [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Took 12.56 seconds to build instance.
Aug 14 12:05:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d500958a-5539-4c90-887a-0b0142856b89 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.810s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG nova.network.neutron [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Successfully updated port: b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquired lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG nova.network.neutron [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG nova.network.neutron [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-87e2c6fe-136e-4cba-8cc6-cbc261f96d9c req-2c46e1c8-d8ae-4385-b4d7-975bfa347cbd service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-changed-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-87e2c6fe-136e-4cba-8cc6-cbc261f96d9c req-2c46e1c8-d8ae-4385-b4d7-975bfa347cbd service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Refreshing instance network info cache due to event network-changed-b32b1a3a-9a4c-4d1d-a455-5d249794cb62. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:05:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87e2c6fe-136e-4cba-8cc6-cbc261f96d9c req-2c46e1c8-d8ae-4385-b4d7-975bfa347cbd service nova] Acquiring lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Successfully updated port: decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquired lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.network.neutron [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Releasing lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance network_info: |[{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87e2c6fe-136e-4cba-8cc6-cbc261f96d9c req-2c46e1c8-d8ae-4385-b4d7-975bfa347cbd service nova] Acquired lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.network.neutron [req-87e2c6fe-136e-4cba-8cc6-cbc261f96d9c req-2c46e1c8-d8ae-4385-b4d7-975bfa347cbd service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Refreshing network info cache for port b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Start _get_guest_xml network_info=[{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:05:43 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:43 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-504953000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-504953000',id=2,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWWx/ILh8Ns58c4RMDmnoFVw+ZxB5woQuR4Ai/Qbq5N2hQQNxo2Z4zYG11WGD0RkrLRIHbTYyq9giarhw3iS5T5OpyaaKY7mJ8oetC+zxpHsTL5Md9DwIWoSBSq3nhyQw==',key_name='tempest-keypair-2108541680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-ie3t5afq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=4c2979a7-addd-4746-be89-9e5cad4cae3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:43 user nova-compute[73012]: DEBUG nova.objects.instance [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:05:44 user nova-compute[73012]:   <uuid>4c2979a7-addd-4746-be89-9e5cad4cae3a</uuid>
Aug 14 12:05:44 user nova-compute[73012]:   <name>instance-00000002</name>
Aug 14 12:05:44 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:05:44 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:05:44 user nova-compute[73012]:   <metadata>
Aug 14 12:05:44 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:05:44 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-504953000</nova:name>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:05:43</nova:creationTime>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:05:44 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:05:44 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:owner>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:user uuid="7648caa38d8e4de6bf9751a512ffb14a">tempest-AttachVolumeShelveTestJSON-192114773-project-member</nova:user>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:project uuid="b522100e4bf447e3b544983c451c3786">tempest-AttachVolumeShelveTestJSON-192114773</nova:project>
Aug 14 12:05:44 user nova-compute[73012]:       </nova:owner>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:ports>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:port uuid="b32b1a3a-9a4c-4d1d-a455-5d249794cb62">
Aug 14 12:05:44 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:05:44 user nova-compute[73012]:         </nova:port>
Aug 14 12:05:44 user nova-compute[73012]:       </nova:ports>
Aug 14 12:05:44 user nova-compute[73012]:     </nova:instance>
Aug 14 12:05:44 user nova-compute[73012]:   </metadata>
Aug 14 12:05:44 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:05:44 user nova-compute[73012]:     <system>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="serial">4c2979a7-addd-4746-be89-9e5cad4cae3a</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="uuid">4c2979a7-addd-4746-be89-9e5cad4cae3a</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:05:44 user nova-compute[73012]:     </system>
Aug 14 12:05:44 user nova-compute[73012]:   </sysinfo>
Aug 14 12:05:44 user nova-compute[73012]:   <os>
Aug 14 12:05:44 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:05:44 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:05:44 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:05:44 user nova-compute[73012]:   </os>
Aug 14 12:05:44 user nova-compute[73012]:   <features>
Aug 14 12:05:44 user nova-compute[73012]:     <acpi/>
Aug 14 12:05:44 user nova-compute[73012]:     <apic/>
Aug 14 12:05:44 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:05:44 user nova-compute[73012]:   </features>
Aug 14 12:05:44 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:05:44 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:05:44 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:05:44 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:05:44 user nova-compute[73012]:   </clock>
Aug 14 12:05:44 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:05:44 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:05:44 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:05:44 user nova-compute[73012]:   </cpu>
Aug 14 12:05:44 user nova-compute[73012]:   <devices>
Aug 14 12:05:44 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:05:44 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:05:44 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk"/>
Aug 14 12:05:44 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:05:44 user nova-compute[73012]:     </disk>
Aug 14 12:05:44 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:05:44 user nova-compute[73012]:       <mac address="fa:16:3e:84:74:b4"/>
Aug 14 12:05:44 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:44 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:05:44 user nova-compute[73012]:       <target dev="tapb32b1a3a-9a"/>
Aug 14 12:05:44 user nova-compute[73012]:     </interface>
Aug 14 12:05:44 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:05:44 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/console.log" append="off"/>
Aug 14 12:05:44 user nova-compute[73012]:     </serial>
Aug 14 12:05:44 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:05:44 user nova-compute[73012]:     <video>
Aug 14 12:05:44 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:44 user nova-compute[73012]:     </video>
Aug 14 12:05:44 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:05:44 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:05:44 user nova-compute[73012]:     </rng>
Aug 14 12:05:44 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:05:44 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:05:44 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:05:44 user nova-compute[73012]:     </memballoon>
Aug 14 12:05:44 user nova-compute[73012]:   </devices>
Aug 14 12:05:44 user nova-compute[73012]: </domain>
Aug 14 12:05:44 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-504953000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-504953000',id=2,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWWx/ILh8Ns58c4RMDmnoFVw+ZxB5woQuR4Ai/Qbq5N2hQQNxo2Z4zYG11WGD0RkrLRIHbTYyq9giarhw3iS5T5OpyaaKY7mJ8oetC+zxpHsTL5Md9DwIWoSBSq3nhyQw==',key_name='tempest-keypair-2108541680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-ie3t5afq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=4c2979a7-addd-4746-be89-9e5cad4cae3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG os_vif [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb32b1a3a-9a, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb32b1a3a-9a, col_values=(('external_ids', {'iface-id': 'b32b1a3a-9a4c-4d1d-a455-5d249794cb62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:74:b4', 'vm-uuid': '4c2979a7-addd-4746-be89-9e5cad4cae3a'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:44 user nova-compute[73012]: INFO os_vif [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a')
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] No VIF found with MAC fa:16:3e:84:74:b4, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Releasing lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Instance network_info: |[{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Start _get_guest_xml network_info=[{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:05:44 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:44 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-378779457',display_name='tempest-ServerStableDeviceRescueTest-server-378779457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-378779457',id=3,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhPwP5jXF/tR02HIssrEdXCa5gf+IGiWLpoNdK1pkyrsEkL2aMd5/ngo3EGORwUePP8rJ9LK39XBThbw2MQLXGlgylxkAyRX5nJ7L3mlOPge3OrXCo4mIv/6zyBAhLeXQ==',key_name='tempest-keypair-1154628437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0b3f5808324dc1994b2264b2a2a878',ramdisk_id='',reservation_id='r-huxlepgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1299098448',owner_user_name='tempest-ServerStableDeviceRescueTest-1299098448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e558a10b41b4c9a9c232742b5cd3564',uuid=0d678d6a-ace6-4bcc-82af-29460c7c50cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Converting VIF {"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f8:c8,bridge_name='br-int',has_traffic_filtering=True,id=decbb2a3-6f5c-48e3-a1ef-ee8237584aeb,network=Network(b6fdd206-2642-429e-8807-483e6d939a72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbb2a3-6f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:05:44 user nova-compute[73012]:   <uuid>0d678d6a-ace6-4bcc-82af-29460c7c50cb</uuid>
Aug 14 12:05:44 user nova-compute[73012]:   <name>instance-00000003</name>
Aug 14 12:05:44 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:05:44 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:05:44 user nova-compute[73012]:   <metadata>
Aug 14 12:05:44 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:05:44 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-378779457</nova:name>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:05:44</nova:creationTime>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:05:44 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:05:44 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:owner>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:user uuid="7e558a10b41b4c9a9c232742b5cd3564">tempest-ServerStableDeviceRescueTest-1299098448-project-member</nova:user>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:project uuid="1b0b3f5808324dc1994b2264b2a2a878">tempest-ServerStableDeviceRescueTest-1299098448</nova:project>
Aug 14 12:05:44 user nova-compute[73012]:       </nova:owner>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:05:44 user nova-compute[73012]:       <nova:ports>
Aug 14 12:05:44 user nova-compute[73012]:         <nova:port uuid="decbb2a3-6f5c-48e3-a1ef-ee8237584aeb">
Aug 14 12:05:44 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 12:05:44 user nova-compute[73012]:         </nova:port>
Aug 14 12:05:44 user nova-compute[73012]:       </nova:ports>
Aug 14 12:05:44 user nova-compute[73012]:     </nova:instance>
Aug 14 12:05:44 user nova-compute[73012]:   </metadata>
Aug 14 12:05:44 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:05:44 user nova-compute[73012]:     <system>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="serial">0d678d6a-ace6-4bcc-82af-29460c7c50cb</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="uuid">0d678d6a-ace6-4bcc-82af-29460c7c50cb</entry>
Aug 14 12:05:44 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:05:44 user nova-compute[73012]:     </system>
Aug 14 12:05:44 user nova-compute[73012]:   </sysinfo>
Aug 14 12:05:44 user nova-compute[73012]:   <os>
Aug 14 12:05:44 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:05:44 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:05:44 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:05:44 user nova-compute[73012]:   </os>
Aug 14 12:05:44 user nova-compute[73012]:   <features>
Aug 14 12:05:44 user nova-compute[73012]:     <acpi/>
Aug 14 12:05:44 user nova-compute[73012]:     <apic/>
Aug 14 12:05:44 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:05:44 user nova-compute[73012]:   </features>
Aug 14 12:05:44 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:05:44 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:05:44 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:05:44 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:05:44 user nova-compute[73012]:   </clock>
Aug 14 12:05:44 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:05:44 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:05:44 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:05:44 user nova-compute[73012]:   </cpu>
Aug 14 12:05:44 user nova-compute[73012]:   <devices>
Aug 14 12:05:44 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:05:44 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:05:44 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk"/>
Aug 14 12:05:44 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:05:44 user nova-compute[73012]:     </disk>
Aug 14 12:05:44 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:05:44 user nova-compute[73012]:       <mac address="fa:16:3e:65:f8:c8"/>
Aug 14 12:05:44 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:44 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:05:44 user nova-compute[73012]:       <target dev="tapdecbb2a3-6f"/>
Aug 14 12:05:44 user nova-compute[73012]:     </interface>
Aug 14 12:05:44 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:05:44 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/console.log" append="off"/>
Aug 14 12:05:44 user nova-compute[73012]:     </serial>
Aug 14 12:05:44 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:05:44 user nova-compute[73012]:     <video>
Aug 14 12:05:44 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:44 user nova-compute[73012]:     </video>
Aug 14 12:05:44 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:05:44 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:05:44 user nova-compute[73012]:     </rng>
Aug 14 12:05:44 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:05:44 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:05:44 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:05:44 user nova-compute[73012]:     </memballoon>
Aug 14 12:05:44 user nova-compute[73012]:   </devices>
Aug 14 12:05:44 user nova-compute[73012]: </domain>
Aug 14 12:05:44 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-378779457',display_name='tempest-ServerStableDeviceRescueTest-server-378779457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-378779457',id=3,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhPwP5jXF/tR02HIssrEdXCa5gf+IGiWLpoNdK1pkyrsEkL2aMd5/ngo3EGORwUePP8rJ9LK39XBThbw2MQLXGlgylxkAyRX5nJ7L3mlOPge3OrXCo4mIv/6zyBAhLeXQ==',key_name='tempest-keypair-1154628437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b0b3f5808324dc1994b2264b2a2a878',ramdisk_id='',reservation_id='r-huxlepgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1299098448',owner_user_name='tempest-ServerStableDeviceRescueTest-1299098448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e558a10b41b4c9a9c232742b5cd3564',uuid=0d678d6a-ace6-4bcc-82af-29460c7c50cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Converting VIF {"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f8:c8,bridge_name='br-int',has_traffic_filtering=True,id=decbb2a3-6f5c-48e3-a1ef-ee8237584aeb,network=Network(b6fdd206-2642-429e-8807-483e6d939a72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbb2a3-6f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG os_vif [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f8:c8,bridge_name='br-int',has_traffic_filtering=True,id=decbb2a3-6f5c-48e3-a1ef-ee8237584aeb,network=Network(b6fdd206-2642-429e-8807-483e6d939a72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbb2a3-6f') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdecbb2a3-6f, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdecbb2a3-6f, col_values=(('external_ids', {'iface-id': 'decbb2a3-6f5c-48e3-a1ef-ee8237584aeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:f8:c8', 'vm-uuid': '0d678d6a-ace6-4bcc-82af-29460c7c50cb'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:44 user nova-compute[73012]: INFO os_vif [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f8:c8,bridge_name='br-int',has_traffic_filtering=True,id=decbb2a3-6f5c-48e3-a1ef-ee8237584aeb,network=Network(b6fdd206-2642-429e-8807-483e6d939a72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbb2a3-6f')
Aug 14 12:05:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] No VIF found with MAC fa:16:3e:65:f8:c8, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-0fc176cc-c11c-4d37-a76c-17b69799f411 req-40226cc0-d026-468b-b7b2-2a4623bea0d0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-changed-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-0fc176cc-c11c-4d37-a76c-17b69799f411 req-40226cc0-d026-468b-b7b2-2a4623bea0d0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Refreshing instance network info cache due to event network-changed-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0fc176cc-c11c-4d37-a76c-17b69799f411 req-40226cc0-d026-468b-b7b2-2a4623bea0d0 service nova] Acquiring lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0fc176cc-c11c-4d37-a76c-17b69799f411 req-40226cc0-d026-468b-b7b2-2a4623bea0d0 service nova] Acquired lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG nova.network.neutron [req-0fc176cc-c11c-4d37-a76c-17b69799f411 req-40226cc0-d026-468b-b7b2-2a4623bea0d0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Refreshing network info cache for port decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG nova.network.neutron [req-87e2c6fe-136e-4cba-8cc6-cbc261f96d9c req-2c46e1c8-d8ae-4385-b4d7-975bfa347cbd service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updated VIF entry in instance network info cache for port b32b1a3a-9a4c-4d1d-a455-5d249794cb62. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG nova.network.neutron [req-87e2c6fe-136e-4cba-8cc6-cbc261f96d9c req-2c46e1c8-d8ae-4385-b4d7-975bfa347cbd service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87e2c6fe-136e-4cba-8cc6-cbc261f96d9c req-2c46e1c8-d8ae-4385-b4d7-975bfa347cbd service nova] Releasing lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG nova.network.neutron [req-0fc176cc-c11c-4d37-a76c-17b69799f411 req-40226cc0-d026-468b-b7b2-2a4623bea0d0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updated VIF entry in instance network info cache for port decbb2a3-6f5c-48e3-a1ef-ee8237584aeb. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG nova.network.neutron [req-0fc176cc-c11c-4d37-a76c-17b69799f411 req-40226cc0-d026-468b-b7b2-2a4623bea0d0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0fc176cc-c11c-4d37-a76c-17b69799f411 req-40226cc0-d026-468b-b7b2-2a4623bea0d0 service nova] Releasing lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.007s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:05:47 user nova-compute[73012]: INFO nova.compute.claims [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Claim successful on node user
Aug 14 12:05:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.283s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:05:48 user nova-compute[73012]: INFO nova.compute.claims [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Claim successful on node user
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:05:48 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.policy [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9442db73842a465493b2e020a0977cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2210f703a6814803bcfb4266d264b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:05:48 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Creating image(s)
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "/opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "/opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "/opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:05:48 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.264s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG nova.policy [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '266f3348f9fe431a8afb6187a2e1cb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d96d1067094c98aa1ae74f4be7f1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.239s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:05:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Creating image(s)
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "/opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "/opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "/opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "2467686ddece399717ca37387e511b746ff9dcfd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "2467686ddece399717ca37387e511b746ff9dcfd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk 1073741824" returned: 0 in 0.081s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.590s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.network.neutron [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Successfully created port: b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Cannot resize image /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.objects.instance [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lazy-loading 'migration_context' on Instance uuid 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Ensure instance console log exists: /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd.part --force-share --output=json" returned: 0 in 0.316s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.virt.images [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] 7938dfef-d3eb-4eb4-8adb-886a305d18cd was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:05:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd.part /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd.part /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd.converted" returned: 0 in 0.284s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Successfully created port: 6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd.converted --force-share --output=json" returned: 0 in 0.377s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "2467686ddece399717ca37387e511b746ff9dcfd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.578s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014750.6593823, 0d678d6a-ace6-4bcc-82af-29460c7c50cb => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:50 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] VM Resumed (Lifecycle Event)
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:05:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Instance spawned successfully.
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance spawned successfully.
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014750.6630564, 0d678d6a-ace6-4bcc-82af-29460c7c50cb => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:50 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] VM Started (Lifecycle Event)
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd --force-share --output=json" returned: 0 in 0.207s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "2467686ddece399717ca37387e511b746ff9dcfd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "2467686ddece399717ca37387e511b746ff9dcfd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:50 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014750.6634076, 4c2979a7-addd-4746-be89-9e5cad4cae3a => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:50 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] VM Resumed (Lifecycle Event)
Aug 14 12:05:50 user nova-compute[73012]: INFO nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Took 15.89 seconds to spawn the instance on the hypervisor.
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:50 user nova-compute[73012]: INFO nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Took 17.44 seconds to spawn the instance on the hypervisor.
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014750.664324, 4c2979a7-addd-4746-be89-9e5cad4cae3a => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] VM Started (Lifecycle Event)
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:51 user nova-compute[73012]: INFO nova.compute.manager [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Took 17.06 seconds to build instance.
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd --force-share --output=json" returned: 0 in 0.262s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd,backing_fmt=raw /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ffaf5dd6-faba-41d8-93dc-21ce42f2c6fe tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.332s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:51 user nova-compute[73012]: INFO nova.compute.manager [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Took 18.60 seconds to build instance.
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd,backing_fmt=raw /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk 1073741824" returned: 0 in 0.082s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "2467686ddece399717ca37387e511b746ff9dcfd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-63be3c64-563b-4c35-8d26-fc37706846ab tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.753s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Successfully updated port: b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquired lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-8b0c8ed4-158a-48e5-b622-25581d1330a2 req-1d433b2e-2328-4345-a8f7-91eb59d93902 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received event network-changed-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-8b0c8ed4-158a-48e5-b622-25581d1330a2 req-1d433b2e-2328-4345-a8f7-91eb59d93902 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Refreshing instance network info cache due to event network-changed-b5e8f694-10fa-4e20-9f7f-6f2336be289e. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8b0c8ed4-158a-48e5-b622-25581d1330a2 req-1d433b2e-2328-4345-a8f7-91eb59d93902 service nova] Acquiring lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd --force-share --output=json" returned: 0 in 0.271s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Cannot resize image /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.objects.instance [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lazy-loading 'migration_context' on Instance uuid 273c3cd7-3897-4079-821b-b477102fd7ba {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Ensure instance console log exists: /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Successfully updated port: 6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "refresh_cache-273c3cd7-3897-4079-821b-b477102fd7ba" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquired lock "refresh_cache-273c3cd7-3897-4079-821b-b477102fd7ba" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:05:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-a98fb665-7916-4229-9725-119bea8e8684 req-d3e740e7-8a39-4c34-a65c-621a82ae6028 service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received event network-vif-plugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a98fb665-7916-4229-9725-119bea8e8684 req-d3e740e7-8a39-4c34-a65c-621a82ae6028 service nova] Acquiring lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a98fb665-7916-4229-9725-119bea8e8684 req-d3e740e7-8a39-4c34-a65c-621a82ae6028 service nova] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a98fb665-7916-4229-9725-119bea8e8684 req-d3e740e7-8a39-4c34-a65c-621a82ae6028 service nova] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-a98fb665-7916-4229-9725-119bea8e8684 req-d3e740e7-8a39-4c34-a65c-621a82ae6028 service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] No waiting events found dispatching network-vif-plugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:05:52 user nova-compute[73012]: WARNING nova.compute.manager [req-a98fb665-7916-4229-9725-119bea8e8684 req-d3e740e7-8a39-4c34-a65c-621a82ae6028 service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received unexpected event network-vif-plugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c for instance with vm_state active and task_state None.
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.network.neutron [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Updating instance_info_cache with network_info: [{"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Releasing lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Instance network_info: |[{"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8b0c8ed4-158a-48e5-b622-25581d1330a2 req-1d433b2e-2328-4345-a8f7-91eb59d93902 service nova] Acquired lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.network.neutron [req-8b0c8ed4-158a-48e5-b622-25581d1330a2 req-1d433b2e-2328-4345-a8f7-91eb59d93902 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Refreshing network info cache for port b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Start _get_guest_xml network_info=[{"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:05:52 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:52 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:05:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1627210626',display_name='tempest-VolumesAdminNegativeTest-server-1627210626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1627210626',id=4,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWIffzF5gVW0jbmrX7gNyr9gakyCbZxb2hIaFq6WiapzdOBPKxKhqmI+OfbRW7LZqvcnW3b/NoPbCZZlhZavW2yx750mkRuF4NwfSDUqO0fg43A1YB/nMloRRcoaGpFoQ==',key_name='tempest-keypair-1825082147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2210f703a6814803bcfb4266d264b0f5',ramdisk_id='',reservation_id='r-7o0ecef4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-384894799',owner_user_name='tempest-VolumesAdminNegativeTest-384894799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9442db73842a465493b2e020a0977cce',uuid=6df0ba9b-0c37-4e43-a6ef-8103c41f33f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converting VIF {"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:4e:b2,bridge_name='br-int',has_traffic_filtering=True,id=b5e8f694-10fa-4e20-9f7f-6f2336be289e,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5e8f694-10') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.objects.instance [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lazy-loading 'pci_devices' on Instance uuid 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:05:53 user nova-compute[73012]:   <uuid>6df0ba9b-0c37-4e43-a6ef-8103c41f33f0</uuid>
Aug 14 12:05:53 user nova-compute[73012]:   <name>instance-00000004</name>
Aug 14 12:05:53 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:05:53 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:05:53 user nova-compute[73012]:   <metadata>
Aug 14 12:05:53 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:05:53 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1627210626</nova:name>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:05:52</nova:creationTime>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:05:53 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:05:53 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:owner>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:user uuid="9442db73842a465493b2e020a0977cce">tempest-VolumesAdminNegativeTest-384894799-project-member</nova:user>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:project uuid="2210f703a6814803bcfb4266d264b0f5">tempest-VolumesAdminNegativeTest-384894799</nova:project>
Aug 14 12:05:53 user nova-compute[73012]:       </nova:owner>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:ports>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:port uuid="b5e8f694-10fa-4e20-9f7f-6f2336be289e">
Aug 14 12:05:53 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:05:53 user nova-compute[73012]:         </nova:port>
Aug 14 12:05:53 user nova-compute[73012]:       </nova:ports>
Aug 14 12:05:53 user nova-compute[73012]:     </nova:instance>
Aug 14 12:05:53 user nova-compute[73012]:   </metadata>
Aug 14 12:05:53 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:05:53 user nova-compute[73012]:     <system>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="serial">6df0ba9b-0c37-4e43-a6ef-8103c41f33f0</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="uuid">6df0ba9b-0c37-4e43-a6ef-8103c41f33f0</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:05:53 user nova-compute[73012]:     </system>
Aug 14 12:05:53 user nova-compute[73012]:   </sysinfo>
Aug 14 12:05:53 user nova-compute[73012]:   <os>
Aug 14 12:05:53 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:05:53 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:05:53 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:05:53 user nova-compute[73012]:   </os>
Aug 14 12:05:53 user nova-compute[73012]:   <features>
Aug 14 12:05:53 user nova-compute[73012]:     <acpi/>
Aug 14 12:05:53 user nova-compute[73012]:     <apic/>
Aug 14 12:05:53 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:05:53 user nova-compute[73012]:   </features>
Aug 14 12:05:53 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:05:53 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:05:53 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:05:53 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:05:53 user nova-compute[73012]:   </clock>
Aug 14 12:05:53 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:05:53 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:05:53 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:05:53 user nova-compute[73012]:   </cpu>
Aug 14 12:05:53 user nova-compute[73012]:   <devices>
Aug 14 12:05:53 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:05:53 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:05:53 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk"/>
Aug 14 12:05:53 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:05:53 user nova-compute[73012]:     </disk>
Aug 14 12:05:53 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:05:53 user nova-compute[73012]:       <mac address="fa:16:3e:79:4e:b2"/>
Aug 14 12:05:53 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:53 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:05:53 user nova-compute[73012]:       <target dev="tapb5e8f694-10"/>
Aug 14 12:05:53 user nova-compute[73012]:     </interface>
Aug 14 12:05:53 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:05:53 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/console.log" append="off"/>
Aug 14 12:05:53 user nova-compute[73012]:     </serial>
Aug 14 12:05:53 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:05:53 user nova-compute[73012]:     <video>
Aug 14 12:05:53 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:53 user nova-compute[73012]:     </video>
Aug 14 12:05:53 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:05:53 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:05:53 user nova-compute[73012]:     </rng>
Aug 14 12:05:53 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:05:53 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:05:53 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:05:53 user nova-compute[73012]:     </memballoon>
Aug 14 12:05:53 user nova-compute[73012]:   </devices>
Aug 14 12:05:53 user nova-compute[73012]: </domain>
Aug 14 12:05:53 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1627210626',display_name='tempest-VolumesAdminNegativeTest-server-1627210626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1627210626',id=4,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWIffzF5gVW0jbmrX7gNyr9gakyCbZxb2hIaFq6WiapzdOBPKxKhqmI+OfbRW7LZqvcnW3b/NoPbCZZlhZavW2yx750mkRuF4NwfSDUqO0fg43A1YB/nMloRRcoaGpFoQ==',key_name='tempest-keypair-1825082147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2210f703a6814803bcfb4266d264b0f5',ramdisk_id='',reservation_id='r-7o0ecef4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-384894799',owner_user_name='tempest-VolumesAdminNegativeTest-384894799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9442db73842a465493b2e020a0977cce',uuid=6df0ba9b-0c37-4e43-a6ef-8103c41f33f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converting VIF {"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:4e:b2,bridge_name='br-int',has_traffic_filtering=True,id=b5e8f694-10fa-4e20-9f7f-6f2336be289e,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5e8f694-10') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG os_vif [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:4e:b2,bridge_name='br-int',has_traffic_filtering=True,id=b5e8f694-10fa-4e20-9f7f-6f2336be289e,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5e8f694-10') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5e8f694-10, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5e8f694-10, col_values=(('external_ids', {'iface-id': 'b5e8f694-10fa-4e20-9f7f-6f2336be289e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:4e:b2', 'vm-uuid': '6df0ba9b-0c37-4e43-a6ef-8103c41f33f0'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:53 user nova-compute[73012]: INFO os_vif [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:4e:b2,bridge_name='br-int',has_traffic_filtering=True,id=b5e8f694-10fa-4e20-9f7f-6f2336be289e,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5e8f694-10')
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] No VIF found with MAC fa:16:3e:79:4e:b2, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Updating instance_info_cache with network_info: [{"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Releasing lock "refresh_cache-273c3cd7-3897-4079-821b-b477102fd7ba" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Instance network_info: |[{"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Start _get_guest_xml network_info=[{"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:05:37Z,direct_url=<?>,disk_format='qcow2',id=7938dfef-d3eb-4eb4-8adb-886a305d18cd,min_disk=0,min_ram=0,name='',owner='93f89187c9074e0d98a7f87f9060c7d1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'disk_bus': 'scsi', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/sda', 'image_id': '7938dfef-d3eb-4eb4-8adb-886a305d18cd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:05:53 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:53 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:05:37Z,direct_url=<?>,disk_format='qcow2',id=7938dfef-d3eb-4eb4-8adb-886a305d18cd,min_disk=0,min_ram=0,name='',owner='93f89187c9074e0d98a7f87f9060c7d1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1888994744',display_name='tempest-AttachSCSIVolumeTestJSON-server-1888994744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1888994744',id=5,image_ref='7938dfef-d3eb-4eb4-8adb-886a305d18cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYuwSUd6ePV2OpwF6INaaJoQucobQiD9Q+hobYo8KAZgKtfQMxhwt4I5BZ1fN9tQKqmUFDw0DHoHxPaJiCq6gMOOi5tdGtdh/ZPQAqF6JY8V00bZqHhfOx4m0tmkl8uqw==',key_name='tempest-keypair-32983871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54d96d1067094c98aa1ae74f4be7f1ff',ramdisk_id='',reservation_id='r-2la2l0cc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7938dfef-d3eb-4eb4-8adb-886a305d18cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-486432696',owner_user_name='tempest-AttachSCSIVolumeTestJSON-486432696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='266f3348f9fe431a8afb6187a2e1cb9e',uuid=273c3cd7-3897-4079-821b-b477102fd7ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Converting VIF {"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:f5:24,bridge_name='br-int',has_traffic_filtering=True,id=6ce711be-e9df-4d5b-9df7-4a039750507d,network=Network(11dbde77-2375-4998-b49c-6f4000a9c1e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce711be-e9') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.objects.instance [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lazy-loading 'pci_devices' on Instance uuid 273c3cd7-3897-4079-821b-b477102fd7ba {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:05:53 user nova-compute[73012]:   <uuid>273c3cd7-3897-4079-821b-b477102fd7ba</uuid>
Aug 14 12:05:53 user nova-compute[73012]:   <name>instance-00000005</name>
Aug 14 12:05:53 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:05:53 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:05:53 user nova-compute[73012]:   <metadata>
Aug 14 12:05:53 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:05:53 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1888994744</nova:name>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:05:53</nova:creationTime>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:05:53 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:05:53 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:owner>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:user uuid="266f3348f9fe431a8afb6187a2e1cb9e">tempest-AttachSCSIVolumeTestJSON-486432696-project-member</nova:user>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:project uuid="54d96d1067094c98aa1ae74f4be7f1ff">tempest-AttachSCSIVolumeTestJSON-486432696</nova:project>
Aug 14 12:05:53 user nova-compute[73012]:       </nova:owner>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:root type="image" uuid="7938dfef-d3eb-4eb4-8adb-886a305d18cd"/>
Aug 14 12:05:53 user nova-compute[73012]:       <nova:ports>
Aug 14 12:05:53 user nova-compute[73012]:         <nova:port uuid="6ce711be-e9df-4d5b-9df7-4a039750507d">
Aug 14 12:05:53 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 12:05:53 user nova-compute[73012]:         </nova:port>
Aug 14 12:05:53 user nova-compute[73012]:       </nova:ports>
Aug 14 12:05:53 user nova-compute[73012]:     </nova:instance>
Aug 14 12:05:53 user nova-compute[73012]:   </metadata>
Aug 14 12:05:53 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:05:53 user nova-compute[73012]:     <system>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="serial">273c3cd7-3897-4079-821b-b477102fd7ba</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="uuid">273c3cd7-3897-4079-821b-b477102fd7ba</entry>
Aug 14 12:05:53 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:05:53 user nova-compute[73012]:     </system>
Aug 14 12:05:53 user nova-compute[73012]:   </sysinfo>
Aug 14 12:05:53 user nova-compute[73012]:   <os>
Aug 14 12:05:53 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:05:53 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:05:53 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:05:53 user nova-compute[73012]:   </os>
Aug 14 12:05:53 user nova-compute[73012]:   <features>
Aug 14 12:05:53 user nova-compute[73012]:     <acpi/>
Aug 14 12:05:53 user nova-compute[73012]:     <apic/>
Aug 14 12:05:53 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:05:53 user nova-compute[73012]:   </features>
Aug 14 12:05:53 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:05:53 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:05:53 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:05:53 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:05:53 user nova-compute[73012]:   </clock>
Aug 14 12:05:53 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:05:53 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:05:53 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:05:53 user nova-compute[73012]:   </cpu>
Aug 14 12:05:53 user nova-compute[73012]:   <devices>
Aug 14 12:05:53 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:05:53 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:05:53 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk"/>
Aug 14 12:05:53 user nova-compute[73012]:       <target dev="sda" bus="scsi"/>
Aug 14 12:05:53 user nova-compute[73012]:       <address type="drive" controller="0" unit="0"/>
Aug 14 12:05:53 user nova-compute[73012]:     </disk>
Aug 14 12:05:53 user nova-compute[73012]:     <disk type="file" device="cdrom">
Aug 14 12:05:53 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 12:05:53 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk.config"/>
Aug 14 12:05:53 user nova-compute[73012]:       <target dev="sdb" bus="scsi"/>
Aug 14 12:05:53 user nova-compute[73012]:       <address type="drive" controller="0" unit="1"/>
Aug 14 12:05:53 user nova-compute[73012]:     </disk>
Aug 14 12:05:53 user nova-compute[73012]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 14 12:05:53 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:05:53 user nova-compute[73012]:       <mac address="fa:16:3e:32:f5:24"/>
Aug 14 12:05:53 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:53 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:05:53 user nova-compute[73012]:       <target dev="tap6ce711be-e9"/>
Aug 14 12:05:53 user nova-compute[73012]:     </interface>
Aug 14 12:05:53 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:05:53 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/console.log" append="off"/>
Aug 14 12:05:53 user nova-compute[73012]:     </serial>
Aug 14 12:05:53 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:05:53 user nova-compute[73012]:     <video>
Aug 14 12:05:53 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:05:53 user nova-compute[73012]:     </video>
Aug 14 12:05:53 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:05:53 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:05:53 user nova-compute[73012]:     </rng>
Aug 14 12:05:53 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:05:53 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:05:53 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:05:53 user nova-compute[73012]:     </memballoon>
Aug 14 12:05:53 user nova-compute[73012]:   </devices>
Aug 14 12:05:53 user nova-compute[73012]: </domain>
Aug 14 12:05:53 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1888994744',display_name='tempest-AttachSCSIVolumeTestJSON-server-1888994744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1888994744',id=5,image_ref='7938dfef-d3eb-4eb4-8adb-886a305d18cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYuwSUd6ePV2OpwF6INaaJoQucobQiD9Q+hobYo8KAZgKtfQMxhwt4I5BZ1fN9tQKqmUFDw0DHoHxPaJiCq6gMOOi5tdGtdh/ZPQAqF6JY8V00bZqHhfOx4m0tmkl8uqw==',key_name='tempest-keypair-32983871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54d96d1067094c98aa1ae74f4be7f1ff',ramdisk_id='',reservation_id='r-2la2l0cc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7938dfef-d3eb-4eb4-8adb-886a305d18cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-486432696',owner_user_name='tempest-AttachSCSIVolumeTestJSON-486432696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='266f3348f9fe431a8afb6187a2e1cb9e',uuid=273c3cd7-3897-4079-821b-b477102fd7ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Converting VIF {"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:f5:24,bridge_name='br-int',has_traffic_filtering=True,id=6ce711be-e9df-4d5b-9df7-4a039750507d,network=Network(11dbde77-2375-4998-b49c-6f4000a9c1e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce711be-e9') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG os_vif [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:f5:24,bridge_name='br-int',has_traffic_filtering=True,id=6ce711be-e9df-4d5b-9df7-4a039750507d,network=Network(11dbde77-2375-4998-b49c-6f4000a9c1e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce711be-e9') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ce711be-e9, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ce711be-e9, col_values=(('external_ids', {'iface-id': '6ce711be-e9df-4d5b-9df7-4a039750507d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:f5:24', 'vm-uuid': '273c3cd7-3897-4079-821b-b477102fd7ba'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:53 user nova-compute[73012]: INFO os_vif [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:f5:24,bridge_name='br-int',has_traffic_filtering=True,id=6ce711be-e9df-4d5b-9df7-4a039750507d,network=Network(11dbde77-2375-4998-b49c-6f4000a9c1e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce711be-e9')
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] No BDM found with device name sda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] No VIF found with MAC fa:16:3e:32:f5:24, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:05:53 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Using config drive
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5bd0abc-9914-4b4d-a6cf-f8c2920829b3 req-a95b67f5-7002-4216-a251-b9ae3b97b8ab service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received event network-changed-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5bd0abc-9914-4b4d-a6cf-f8c2920829b3 req-a95b67f5-7002-4216-a251-b9ae3b97b8ab service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Refreshing instance network info cache due to event network-changed-6ce711be-e9df-4d5b-9df7-4a039750507d. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5bd0abc-9914-4b4d-a6cf-f8c2920829b3 req-a95b67f5-7002-4216-a251-b9ae3b97b8ab service nova] Acquiring lock "refresh_cache-273c3cd7-3897-4079-821b-b477102fd7ba" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5bd0abc-9914-4b4d-a6cf-f8c2920829b3 req-a95b67f5-7002-4216-a251-b9ae3b97b8ab service nova] Acquired lock "refresh_cache-273c3cd7-3897-4079-821b-b477102fd7ba" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:05:53 user nova-compute[73012]: DEBUG nova.network.neutron [req-f5bd0abc-9914-4b4d-a6cf-f8c2920829b3 req-a95b67f5-7002-4216-a251-b9ae3b97b8ab service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Refreshing network info cache for port 6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG nova.network.neutron [req-8b0c8ed4-158a-48e5-b622-25581d1330a2 req-1d433b2e-2328-4345-a8f7-91eb59d93902 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Updated VIF entry in instance network info cache for port b5e8f694-10fa-4e20-9f7f-6f2336be289e. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG nova.network.neutron [req-8b0c8ed4-158a-48e5-b622-25581d1330a2 req-1d433b2e-2328-4345-a8f7-91eb59d93902 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Updating instance_info_cache with network_info: [{"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8b0c8ed4-158a-48e5-b622-25581d1330a2 req-1d433b2e-2328-4345-a8f7-91eb59d93902 service nova] Releasing lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG nova.network.neutron [req-f5bd0abc-9914-4b4d-a6cf-f8c2920829b3 req-a95b67f5-7002-4216-a251-b9ae3b97b8ab service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Updated VIF entry in instance network info cache for port 6ce711be-e9df-4d5b-9df7-4a039750507d. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG nova.network.neutron [req-f5bd0abc-9914-4b4d-a6cf-f8c2920829b3 req-a95b67f5-7002-4216-a251-b9ae3b97b8ab service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Updating instance_info_cache with network_info: [{"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:05:54 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Creating config drive at /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk.config
Aug 14 12:05:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7g0y61j2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5bd0abc-9914-4b4d-a6cf-f8c2920829b3 req-a95b67f5-7002-4216-a251-b9ae3b97b8ab service nova] Releasing lock "refresh_cache-273c3cd7-3897-4079-821b-b477102fd7ba" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-81b256db-c00d-4337-a007-51f51a111b21 req-17e49fe9-09f2-464d-98da-9c193c79dece service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received event network-vif-plugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-81b256db-c00d-4337-a007-51f51a111b21 req-17e49fe9-09f2-464d-98da-9c193c79dece service nova] Acquiring lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-81b256db-c00d-4337-a007-51f51a111b21 req-17e49fe9-09f2-464d-98da-9c193c79dece service nova] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-81b256db-c00d-4337-a007-51f51a111b21 req-17e49fe9-09f2-464d-98da-9c193c79dece service nova] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-81b256db-c00d-4337-a007-51f51a111b21 req-17e49fe9-09f2-464d-98da-9c193c79dece service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] No waiting events found dispatching network-vif-plugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:05:54 user nova-compute[73012]: WARNING nova.compute.manager [req-81b256db-c00d-4337-a007-51f51a111b21 req-17e49fe9-09f2-464d-98da-9c193c79dece service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received unexpected event network-vif-plugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c for instance with vm_state active and task_state None.
Aug 14 12:05:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7g0y61j2" returned: 0 in 0.084s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-dbe987ac-aa33-4840-83b6-371ef7061479 req-01f71b18-61f0-4cc1-ba6a-dbe0a2b376a4 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received event network-vif-plugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dbe987ac-aa33-4840-83b6-371ef7061479 req-01f71b18-61f0-4cc1-ba6a-dbe0a2b376a4 service nova] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dbe987ac-aa33-4840-83b6-371ef7061479 req-01f71b18-61f0-4cc1-ba6a-dbe0a2b376a4 service nova] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dbe987ac-aa33-4840-83b6-371ef7061479 req-01f71b18-61f0-4cc1-ba6a-dbe0a2b376a4 service nova] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-dbe987ac-aa33-4840-83b6-371ef7061479 req-01f71b18-61f0-4cc1-ba6a-dbe0a2b376a4 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] No waiting events found dispatching network-vif-plugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:05:55 user nova-compute[73012]: WARNING nova.compute.manager [req-dbe987ac-aa33-4840-83b6-371ef7061479 req-01f71b18-61f0-4cc1-ba6a-dbe0a2b376a4 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received unexpected event network-vif-plugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e for instance with vm_state building and task_state spawning.
Aug 14 12:05:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-c32311dd-a532-42ec-bbdf-98cdafcd1caa req-3918fe6f-030b-43b3-ad54-98227d5cff38 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received event network-vif-plugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c32311dd-a532-42ec-bbdf-98cdafcd1caa req-3918fe6f-030b-43b3-ad54-98227d5cff38 service nova] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c32311dd-a532-42ec-bbdf-98cdafcd1caa req-3918fe6f-030b-43b3-ad54-98227d5cff38 service nova] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c32311dd-a532-42ec-bbdf-98cdafcd1caa req-3918fe6f-030b-43b3-ad54-98227d5cff38 service nova] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-c32311dd-a532-42ec-bbdf-98cdafcd1caa req-3918fe6f-030b-43b3-ad54-98227d5cff38 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] No waiting events found dispatching network-vif-plugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:05:57 user nova-compute[73012]: WARNING nova.compute.manager [req-c32311dd-a532-42ec-bbdf-98cdafcd1caa req-3918fe6f-030b-43b3-ad54-98227d5cff38 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received unexpected event network-vif-plugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e for instance with vm_state building and task_state spawning.
Aug 14 12:05:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014759.0892045, 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] VM Resumed (Lifecycle Event)
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-2edd6611-fe1a-48b9-9e08-67f0d5e7a00e req-186cf051-45cc-4648-b549-66c9fe420f94 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2edd6611-fe1a-48b9-9e08-67f0d5e7a00e req-186cf051-45cc-4648-b549-66c9fe420f94 service nova] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2edd6611-fe1a-48b9-9e08-67f0d5e7a00e req-186cf051-45cc-4648-b549-66c9fe420f94 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2edd6611-fe1a-48b9-9e08-67f0d5e7a00e req-186cf051-45cc-4648-b549-66c9fe420f94 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-2edd6611-fe1a-48b9-9e08-67f0d5e7a00e req-186cf051-45cc-4648-b549-66c9fe420f94 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] No waiting events found dispatching network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:05:59 user nova-compute[73012]: WARNING nova.compute.manager [req-2edd6611-fe1a-48b9-9e08-67f0d5e7a00e req-186cf051-45cc-4648-b549-66c9fe420f94 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received unexpected event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 for instance with vm_state active and task_state None.
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Instance spawned successfully.
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014759.0898755, 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] VM Started (Lifecycle Event)
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Took 10.82 seconds to spawn the instance on the hypervisor.
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Took 11.93 seconds to build instance.
Aug 14 12:05:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-395dedaf-9de0-4611-8e3a-f1d4300a4f92 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.091s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014759.5577788, 273c3cd7-3897-4079-821b-b477102fd7ba => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] VM Resumed (Lifecycle Event)
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Instance spawned successfully.
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014759.5622845, 273c3cd7-3897-4079-821b-b477102fd7ba => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] VM Started (Lifecycle Event)
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Took 10.69 seconds to spawn the instance on the hypervisor.
Aug 14 12:05:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:05:59 user nova-compute[73012]: INFO nova.compute.manager [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Took 12.13 seconds to build instance.
Aug 14 12:05:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-34126530-270b-4aca-bea1-3ab46a1c28b2 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.284s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-06005e10-1372-4636-a605-35c4598561ce req-5d72bff0-03ff-4bb5-8a10-a0922e20717e service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-06005e10-1372-4636-a605-35c4598561ce req-5d72bff0-03ff-4bb5-8a10-a0922e20717e service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-06005e10-1372-4636-a605-35c4598561ce req-5d72bff0-03ff-4bb5-8a10-a0922e20717e service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-06005e10-1372-4636-a605-35c4598561ce req-5d72bff0-03ff-4bb5-8a10-a0922e20717e service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-06005e10-1372-4636-a605-35c4598561ce req-5d72bff0-03ff-4bb5-8a10-a0922e20717e service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:00 user nova-compute[73012]: WARNING nova.compute.manager [req-06005e10-1372-4636-a605-35c4598561ce req-5d72bff0-03ff-4bb5-8a10-a0922e20717e service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state active and task_state None.
Aug 14 12:06:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-67bbfe52-0d24-4608-888b-41e9619e9200 req-f5c8e67e-867d-42a6-a36f-a855bed00f61 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-67bbfe52-0d24-4608-888b-41e9619e9200 req-f5c8e67e-867d-42a6-a36f-a855bed00f61 service nova] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-67bbfe52-0d24-4608-888b-41e9619e9200 req-f5c8e67e-867d-42a6-a36f-a855bed00f61 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-67bbfe52-0d24-4608-888b-41e9619e9200 req-f5c8e67e-867d-42a6-a36f-a855bed00f61 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-67bbfe52-0d24-4608-888b-41e9619e9200 req-f5c8e67e-867d-42a6-a36f-a855bed00f61 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] No waiting events found dispatching network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:01 user nova-compute[73012]: WARNING nova.compute.manager [req-67bbfe52-0d24-4608-888b-41e9619e9200 req-f5c8e67e-867d-42a6-a36f-a855bed00f61 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received unexpected event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 for instance with vm_state active and task_state None.
Aug 14 12:06:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:06:02 user nova-compute[73012]: INFO nova.compute.claims [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Claim successful on node user
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:02 user nova-compute[73012]: WARNING nova.compute.manager [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state active and task_state None.
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received event network-vif-plugged-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] No waiting events found dispatching network-vif-plugged-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:02 user nova-compute[73012]: WARNING nova.compute.manager [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received unexpected event network-vif-plugged-6ce711be-e9df-4d5b-9df7-4a039750507d for instance with vm_state active and task_state None.
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received event network-vif-plugged-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] No waiting events found dispatching network-vif-plugged-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:02 user nova-compute[73012]: WARNING nova.compute.manager [req-e1a089ae-9ab7-491a-bb9d-5a1a915e5fbd req-d068b8be-c609-473a-9525-4d2334090e27 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received unexpected event network-vif-plugged-6ce711be-e9df-4d5b-9df7-4a039750507d for instance with vm_state active and task_state None.
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.766s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG nova.network.neutron [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:06:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:06:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:06:03 user nova-compute[73012]: INFO nova.compute.claims [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Claim successful on node user
Aug 14 12:06:03 user nova-compute[73012]: DEBUG nova.policy [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '693ca10f33fd4efba6ea8b4b8f3aacf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747825102fc4c2bb39eccf5ead6e113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:06:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Creating image(s)
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquiring lock "/opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "/opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "/opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.324s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.365s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.917s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk 1073741824" returned: 0 in 0.203s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.604s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:04 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.278s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.policy [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3348290413e74695a039f4a8a611248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5076cfad0e44389c04b5002f4578db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:06:04 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Creating image(s)
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "/opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "/opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG nova.network.neutron [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Successfully created port: 04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json" returned: 0 in 0.395s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Cannot resize image /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG nova.objects.instance [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lazy-loading 'migration_context' on Instance uuid e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Ensure instance console log exists: /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.300s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.296s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk 1073741824" returned: 0 in 0.094s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.411s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.312s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Cannot resize image /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lazy-loading 'migration_context' on Instance uuid ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Ensure instance console log exists: /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.network.neutron [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Successfully updated port: 04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquiring lock "refresh_cache-e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquired lock "refresh_cache-e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.network.neutron [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Successfully created port: fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-2de46be6-123f-42c3-b1ed-a78bf0082648 req-8accdb3e-452e-4864-9321-6c13b39ba090 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received event network-changed-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-2de46be6-123f-42c3-b1ed-a78bf0082648 req-8accdb3e-452e-4864-9321-6c13b39ba090 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Refreshing instance network info cache due to event network-changed-04bdd88d-db33-48f1-8154-b4fec28a16cf. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2de46be6-123f-42c3-b1ed-a78bf0082648 req-8accdb3e-452e-4864-9321-6c13b39ba090 service nova] Acquiring lock "refresh_cache-e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.network.neutron [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:06:07 user nova-compute[73012]: INFO nova.compute.claims [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Claim successful on node user
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.network.neutron [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Updating instance_info_cache with network_info: [{"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Releasing lock "refresh_cache-e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Instance network_info: |[{"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2de46be6-123f-42c3-b1ed-a78bf0082648 req-8accdb3e-452e-4864-9321-6c13b39ba090 service nova] Acquired lock "refresh_cache-e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.network.neutron [req-2de46be6-123f-42c3-b1ed-a78bf0082648 req-8accdb3e-452e-4864-9321-6c13b39ba090 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Refreshing network info cache for port 04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Start _get_guest_xml network_info=[{"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:06:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1659614832',display_name='tempest-VolumesAssistedSnapshotsTest-server-1659614832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1659614832',id=6,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCls6nW3QlKre9ktWyCj8bewjrRrWyuGhtewhjlSWYbuaGyEWmJadvZLBGaF6EfktM0mqir/aYl7MGSs5wESGIBWQ1Xp9URlDUgWCyl9WyEkJB1R2+Av3aNO/Dox+RpPfw==',key_name='tempest-keypair-126397586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3747825102fc4c2bb39eccf5ead6e113',ramdisk_id='',reservation_id='r-mi3ge7ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-154964725',owner_user_name='tempest-VolumesAssistedSnapshotsTest-154964725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693ca10f33fd4efba6ea8b4b8f3aacf0',uuid=e67d6abc-b9b5-4c6d-83e0-1e064928dfd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Converting VIF {"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=04bdd88d-db33-48f1-8154-b4fec28a16cf,network=Network(eb9529e6-f99b-4b8b-bb36-73e95db30277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bdd88d-db') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lazy-loading 'pci_devices' on Instance uuid e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:06:07 user nova-compute[73012]:   <uuid>e67d6abc-b9b5-4c6d-83e0-1e064928dfd7</uuid>
Aug 14 12:06:07 user nova-compute[73012]:   <name>instance-00000006</name>
Aug 14 12:06:07 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:06:07 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:06:07 user nova-compute[73012]:   <metadata>
Aug 14 12:06:07 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:06:07 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:06:07 user nova-compute[73012]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1659614832</nova:name>
Aug 14 12:06:07 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:06:07</nova:creationTime>
Aug 14 12:06:07 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:06:07 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:06:07 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:06:07 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:06:07 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:06:07 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:06:07 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:06:07 user nova-compute[73012]:       <nova:owner>
Aug 14 12:06:07 user nova-compute[73012]:         <nova:user uuid="693ca10f33fd4efba6ea8b4b8f3aacf0">tempest-VolumesAssistedSnapshotsTest-154964725-project-member</nova:user>
Aug 14 12:06:07 user nova-compute[73012]:         <nova:project uuid="3747825102fc4c2bb39eccf5ead6e113">tempest-VolumesAssistedSnapshotsTest-154964725</nova:project>
Aug 14 12:06:07 user nova-compute[73012]:       </nova:owner>
Aug 14 12:06:07 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:06:07 user nova-compute[73012]:       <nova:ports>
Aug 14 12:06:07 user nova-compute[73012]:         <nova:port uuid="04bdd88d-db33-48f1-8154-b4fec28a16cf">
Aug 14 12:06:07 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 12:06:07 user nova-compute[73012]:         </nova:port>
Aug 14 12:06:07 user nova-compute[73012]:       </nova:ports>
Aug 14 12:06:07 user nova-compute[73012]:     </nova:instance>
Aug 14 12:06:07 user nova-compute[73012]:   </metadata>
Aug 14 12:06:07 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:06:07 user nova-compute[73012]:     <system>
Aug 14 12:06:07 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:06:07 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:06:07 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:06:07 user nova-compute[73012]:       <entry name="serial">e67d6abc-b9b5-4c6d-83e0-1e064928dfd7</entry>
Aug 14 12:06:07 user nova-compute[73012]:       <entry name="uuid">e67d6abc-b9b5-4c6d-83e0-1e064928dfd7</entry>
Aug 14 12:06:07 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:06:07 user nova-compute[73012]:     </system>
Aug 14 12:06:07 user nova-compute[73012]:   </sysinfo>
Aug 14 12:06:07 user nova-compute[73012]:   <os>
Aug 14 12:06:07 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:06:07 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:06:07 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:06:07 user nova-compute[73012]:   </os>
Aug 14 12:06:07 user nova-compute[73012]:   <features>
Aug 14 12:06:07 user nova-compute[73012]:     <acpi/>
Aug 14 12:06:07 user nova-compute[73012]:     <apic/>
Aug 14 12:06:07 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:06:07 user nova-compute[73012]:   </features>
Aug 14 12:06:07 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:06:07 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:06:07 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:06:07 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:06:07 user nova-compute[73012]:   </clock>
Aug 14 12:06:07 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:06:07 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:06:07 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:06:07 user nova-compute[73012]:   </cpu>
Aug 14 12:06:07 user nova-compute[73012]:   <devices>
Aug 14 12:06:07 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:06:07 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:06:07 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk"/>
Aug 14 12:06:07 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:06:07 user nova-compute[73012]:     </disk>
Aug 14 12:06:07 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:06:07 user nova-compute[73012]:       <mac address="fa:16:3e:1b:4d:05"/>
Aug 14 12:06:07 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:06:07 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:06:07 user nova-compute[73012]:       <target dev="tap04bdd88d-db"/>
Aug 14 12:06:07 user nova-compute[73012]:     </interface>
Aug 14 12:06:07 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:06:07 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/console.log" append="off"/>
Aug 14 12:06:07 user nova-compute[73012]:     </serial>
Aug 14 12:06:07 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:06:07 user nova-compute[73012]:     <video>
Aug 14 12:06:07 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:06:07 user nova-compute[73012]:     </video>
Aug 14 12:06:07 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:06:07 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:06:07 user nova-compute[73012]:     </rng>
Aug 14 12:06:07 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:06:07 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:06:07 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:06:07 user nova-compute[73012]:     </memballoon>
Aug 14 12:06:07 user nova-compute[73012]:   </devices>
Aug 14 12:06:07 user nova-compute[73012]: </domain>
Aug 14 12:06:07 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1659614832',display_name='tempest-VolumesAssistedSnapshotsTest-server-1659614832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1659614832',id=6,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCls6nW3QlKre9ktWyCj8bewjrRrWyuGhtewhjlSWYbuaGyEWmJadvZLBGaF6EfktM0mqir/aYl7MGSs5wESGIBWQ1Xp9URlDUgWCyl9WyEkJB1R2+Av3aNO/Dox+RpPfw==',key_name='tempest-keypair-126397586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3747825102fc4c2bb39eccf5ead6e113',ramdisk_id='',reservation_id='r-mi3ge7ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-154964725',owner_user_name='tempest-VolumesAssistedSnapshotsTest-154964725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693ca10f33fd4efba6ea8b4b8f3aacf0',uuid=e67d6abc-b9b5-4c6d-83e0-1e064928dfd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Converting VIF {"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=04bdd88d-db33-48f1-8154-b4fec28a16cf,network=Network(eb9529e6-f99b-4b8b-bb36-73e95db30277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bdd88d-db') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG os_vif [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=04bdd88d-db33-48f1-8154-b4fec28a16cf,network=Network(eb9529e6-f99b-4b8b-bb36-73e95db30277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bdd88d-db') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04bdd88d-db, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04bdd88d-db, col_values=(('external_ids', {'iface-id': '04bdd88d-db33-48f1-8154-b4fec28a16cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:4d:05', 'vm-uuid': 'e67d6abc-b9b5-4c6d-83e0-1e064928dfd7'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:07 user nova-compute[73012]: INFO os_vif [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=04bdd88d-db33-48f1-8154-b4fec28a16cf,network=Network(eb9529e6-f99b-4b8b-bb36-73e95db30277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bdd88d-db')
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] No VIF found with MAC fa:16:3e:1b:4d:05, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:06:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.052s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:06:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Successfully updated port: fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "refresh_cache-ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquired lock "refresh_cache-ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-4725dc12-429f-4102-83a6-a4fbae525b00 req-328ddfb2-fc3a-4486-93cf-4060f5fbf05c service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received event network-changed-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-4725dc12-429f-4102-83a6-a4fbae525b00 req-328ddfb2-fc3a-4486-93cf-4060f5fbf05c service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Refreshing instance network info cache due to event network-changed-fce00ee4-2792-4ba8-b784-985ba783b386. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4725dc12-429f-4102-83a6-a4fbae525b00 req-328ddfb2-fc3a-4486-93cf-4060f5fbf05c service nova] Acquiring lock "refresh_cache-ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.policy [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bd40979075344b28d0223d4b5084508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60f4140fa9e464ba556f644132aad96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:06:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Creating image(s)
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.network.neutron [req-2de46be6-123f-42c3-b1ed-a78bf0082648 req-8accdb3e-452e-4864-9321-6c13b39ba090 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Updated VIF entry in instance network info cache for port 04bdd88d-db33-48f1-8154-b4fec28a16cf. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG nova.network.neutron [req-2de46be6-123f-42c3-b1ed-a78bf0082648 req-8accdb3e-452e-4864-9321-6c13b39ba090 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Updating instance_info_cache with network_info: [{"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2de46be6-123f-42c3-b1ed-a78bf0082648 req-8accdb3e-452e-4864-9321-6c13b39ba090 service nova] Releasing lock "refresh_cache-e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.244s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Updating instance_info_cache with network_info: [{"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Releasing lock "refresh_cache-ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Instance network_info: |[{"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4725dc12-429f-4102-83a6-a4fbae525b00 req-328ddfb2-fc3a-4486-93cf-4060f5fbf05c service nova] Acquired lock "refresh_cache-ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.network.neutron [req-4725dc12-429f-4102-83a6-a4fbae525b00 req-328ddfb2-fc3a-4486-93cf-4060f5fbf05c service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Refreshing network info cache for port fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Start _get_guest_xml network_info=[{"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.282s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:09 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:09 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk 1073741824" returned: 0 in 0.082s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1333745736',display_name='tempest-TestVolumeSwap-server-1333745736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1333745736',id=7,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMZT4vkolk2U5lO7eT+pPSYOwWwcMOjp+AsI8OWt6t5JxpsGpWb/q/2EMxXxdxPFTSq8Dl4qq/CEqPPII8t6c6Efigaxs1FTm9reB27ACjpE8O99DUtE5Dn7lcA0W38Q==',key_name='tempest-keypair-1069442216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba5076cfad0e44389c04b5002f4578db',ramdisk_id='',reservation_id='r-nug0o7o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1775034873',owner_user_name='tempest-TestVolumeSwap-1775034873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3348290413e74695a039f4a8a611248b',uuid=ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Converting VIF {"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:34:8f,bridge_name='br-int',has_traffic_filtering=True,id=fce00ee4-2792-4ba8-b784-985ba783b386,network=Network(cc18f1ab-771b-422f-9729-d43c55236649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce00ee4-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lazy-loading 'pci_devices' on Instance uuid ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:06:09 user nova-compute[73012]:   <uuid>ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874</uuid>
Aug 14 12:06:09 user nova-compute[73012]:   <name>instance-00000007</name>
Aug 14 12:06:09 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:06:09 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:06:09 user nova-compute[73012]:   <metadata>
Aug 14 12:06:09 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:06:09 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:06:09 user nova-compute[73012]:       <nova:name>tempest-TestVolumeSwap-server-1333745736</nova:name>
Aug 14 12:06:09 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:06:09</nova:creationTime>
Aug 14 12:06:09 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:06:09 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:06:09 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:06:09 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:06:09 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:06:09 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:06:09 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:06:09 user nova-compute[73012]:       <nova:owner>
Aug 14 12:06:09 user nova-compute[73012]:         <nova:user uuid="3348290413e74695a039f4a8a611248b">tempest-TestVolumeSwap-1775034873-project-member</nova:user>
Aug 14 12:06:09 user nova-compute[73012]:         <nova:project uuid="ba5076cfad0e44389c04b5002f4578db">tempest-TestVolumeSwap-1775034873</nova:project>
Aug 14 12:06:09 user nova-compute[73012]:       </nova:owner>
Aug 14 12:06:09 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:06:09 user nova-compute[73012]:       <nova:ports>
Aug 14 12:06:09 user nova-compute[73012]:         <nova:port uuid="fce00ee4-2792-4ba8-b784-985ba783b386">
Aug 14 12:06:09 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:06:09 user nova-compute[73012]:         </nova:port>
Aug 14 12:06:09 user nova-compute[73012]:       </nova:ports>
Aug 14 12:06:09 user nova-compute[73012]:     </nova:instance>
Aug 14 12:06:09 user nova-compute[73012]:   </metadata>
Aug 14 12:06:09 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:06:09 user nova-compute[73012]:     <system>
Aug 14 12:06:09 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:06:09 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:06:09 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:06:09 user nova-compute[73012]:       <entry name="serial">ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874</entry>
Aug 14 12:06:09 user nova-compute[73012]:       <entry name="uuid">ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874</entry>
Aug 14 12:06:09 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:06:09 user nova-compute[73012]:     </system>
Aug 14 12:06:09 user nova-compute[73012]:   </sysinfo>
Aug 14 12:06:09 user nova-compute[73012]:   <os>
Aug 14 12:06:09 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:06:09 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:06:09 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:06:09 user nova-compute[73012]:   </os>
Aug 14 12:06:09 user nova-compute[73012]:   <features>
Aug 14 12:06:09 user nova-compute[73012]:     <acpi/>
Aug 14 12:06:09 user nova-compute[73012]:     <apic/>
Aug 14 12:06:09 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:06:09 user nova-compute[73012]:   </features>
Aug 14 12:06:09 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:06:09 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:06:09 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:06:09 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:06:09 user nova-compute[73012]:   </clock>
Aug 14 12:06:09 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:06:09 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:06:09 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:06:09 user nova-compute[73012]:   </cpu>
Aug 14 12:06:09 user nova-compute[73012]:   <devices>
Aug 14 12:06:09 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:06:09 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:06:09 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk"/>
Aug 14 12:06:09 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:06:09 user nova-compute[73012]:     </disk>
Aug 14 12:06:09 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:06:09 user nova-compute[73012]:       <mac address="fa:16:3e:74:34:8f"/>
Aug 14 12:06:09 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:06:09 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:06:09 user nova-compute[73012]:       <target dev="tapfce00ee4-27"/>
Aug 14 12:06:09 user nova-compute[73012]:     </interface>
Aug 14 12:06:09 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:06:09 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/console.log" append="off"/>
Aug 14 12:06:09 user nova-compute[73012]:     </serial>
Aug 14 12:06:09 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:06:09 user nova-compute[73012]:     <video>
Aug 14 12:06:09 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:06:09 user nova-compute[73012]:     </video>
Aug 14 12:06:09 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:06:09 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:06:09 user nova-compute[73012]:     </rng>
Aug 14 12:06:09 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:06:09 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:06:09 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:06:09 user nova-compute[73012]:     </memballoon>
Aug 14 12:06:09 user nova-compute[73012]:   </devices>
Aug 14 12:06:09 user nova-compute[73012]: </domain>
Aug 14 12:06:09 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1333745736',display_name='tempest-TestVolumeSwap-server-1333745736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1333745736',id=7,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMZT4vkolk2U5lO7eT+pPSYOwWwcMOjp+AsI8OWt6t5JxpsGpWb/q/2EMxXxdxPFTSq8Dl4qq/CEqPPII8t6c6Efigaxs1FTm9reB27ACjpE8O99DUtE5Dn7lcA0W38Q==',key_name='tempest-keypair-1069442216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba5076cfad0e44389c04b5002f4578db',ramdisk_id='',reservation_id='r-nug0o7o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1775034873',owner_user_name='tempest-TestVolumeSwap-1775034873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3348290413e74695a039f4a8a611248b',uuid=ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Converting VIF {"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:34:8f,bridge_name='br-int',has_traffic_filtering=True,id=fce00ee4-2792-4ba8-b784-985ba783b386,network=Network(cc18f1ab-771b-422f-9729-d43c55236649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce00ee4-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG os_vif [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:34:8f,bridge_name='br-int',has_traffic_filtering=True,id=fce00ee4-2792-4ba8-b784-985ba783b386,network=Network(cc18f1ab-771b-422f-9729-d43c55236649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce00ee4-27') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfce00ee4-27, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfce00ee4-27, col_values=(('external_ids', {'iface-id': 'fce00ee4-2792-4ba8-b784-985ba783b386', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:34:8f', 'vm-uuid': 'ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.252s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:09 user nova-compute[73012]: INFO os_vif [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:34:8f,bridge_name='br-int',has_traffic_filtering=True,id=fce00ee4-2792-4ba8-b784-985ba783b386,network=Network(cc18f1ab-771b-422f-9729-d43c55236649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce00ee4-27')
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Successfully created port: 30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] No VIF found with MAC fa:16:3e:74:34:8f, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Cannot resize image /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.objects.instance [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lazy-loading 'migration_context' on Instance uuid 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Ensure instance console log exists: /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-4725dc12-429f-4102-83a6-a4fbae525b00 req-328ddfb2-fc3a-4486-93cf-4060f5fbf05c service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Updated VIF entry in instance network info cache for port fce00ee4-2792-4ba8-b784-985ba783b386. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-4725dc12-429f-4102-83a6-a4fbae525b00 req-328ddfb2-fc3a-4486-93cf-4060f5fbf05c service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Updating instance_info_cache with network_info: [{"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4725dc12-429f-4102-83a6-a4fbae525b00 req-328ddfb2-fc3a-4486-93cf-4060f5fbf05c service nova] Releasing lock "refresh_cache-ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-cc43ae04-0450-4973-b271-b950568fd7cc req-c141c020-4b43-43e5-8313-59678f286337 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received event network-vif-plugged-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cc43ae04-0450-4973-b271-b950568fd7cc req-c141c020-4b43-43e5-8313-59678f286337 service nova] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cc43ae04-0450-4973-b271-b950568fd7cc req-c141c020-4b43-43e5-8313-59678f286337 service nova] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cc43ae04-0450-4973-b271-b950568fd7cc req-c141c020-4b43-43e5-8313-59678f286337 service nova] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-cc43ae04-0450-4973-b271-b950568fd7cc req-c141c020-4b43-43e5-8313-59678f286337 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] No waiting events found dispatching network-vif-plugged-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:10 user nova-compute[73012]: WARNING nova.compute.manager [req-cc43ae04-0450-4973-b271-b950568fd7cc req-c141c020-4b43-43e5-8313-59678f286337 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received unexpected event network-vif-plugged-04bdd88d-db33-48f1-8154-b4fec28a16cf for instance with vm_state building and task_state spawning.
Aug 14 12:06:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Successfully updated port: 30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:06:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:06:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquired lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:06:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:06:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:06:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updating instance_info_cache with network_info: [{"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Releasing lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Instance network_info: |[{"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Start _get_guest_xml network_info=[{"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:06:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-956d82d4-6cb7-4937-8c7b-7cabfabc3102 req-fad819c8-d6b6-40c6-985b-8b2b3a06bf52 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received event network-vif-plugged-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-956d82d4-6cb7-4937-8c7b-7cabfabc3102 req-fad819c8-d6b6-40c6-985b-8b2b3a06bf52 service nova] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-956d82d4-6cb7-4937-8c7b-7cabfabc3102 req-fad819c8-d6b6-40c6-985b-8b2b3a06bf52 service nova] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-956d82d4-6cb7-4937-8c7b-7cabfabc3102 req-fad819c8-d6b6-40c6-985b-8b2b3a06bf52 service nova] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-956d82d4-6cb7-4937-8c7b-7cabfabc3102 req-fad819c8-d6b6-40c6-985b-8b2b3a06bf52 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] No waiting events found dispatching network-vif-plugged-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:12 user nova-compute[73012]: WARNING nova.compute.manager [req-956d82d4-6cb7-4937-8c7b-7cabfabc3102 req-fad819c8-d6b6-40c6-985b-8b2b3a06bf52 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received unexpected event network-vif-plugged-fce00ee4-2792-4ba8-b784-985ba783b386 for instance with vm_state building and task_state spawning.
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517741125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517741125',id=8,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2TTpmfaQPgY9ohNbVadAHJOLiNi1lPNazCQ0/vgYaopsQex8HgTVtrzr1PsGl+iZ8XzkXNAGaX1YvJAn1t8iAMrG6pCLvmKBNfbkLxAoKRO+zDopEQxka9+HZl/6dPMQ==',key_name='tempest-keypair-779145758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a60f4140fa9e464ba556f644132aad96',ramdisk_id='',reservation_id='r-7nj3lvpu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1305129888',owner_user_name='tempest-TaggedAttachmentsTest-1305129888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd40979075344b28d0223d4b5084508',uuid=96b9a98d-d416-40ef-aa85-ce23ad77e9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converting VIF {"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=30ec13f3-55af-4216-a06e-63bc7b1fb9b6,network=Network(afb0b1b7-00d0-4088-a3d4-2b0a7323d79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30ec13f3-55') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lazy-loading 'pci_devices' on Instance uuid 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:06:12 user nova-compute[73012]:   <uuid>96b9a98d-d416-40ef-aa85-ce23ad77e9d7</uuid>
Aug 14 12:06:12 user nova-compute[73012]:   <name>instance-00000008</name>
Aug 14 12:06:12 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:06:12 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:06:12 user nova-compute[73012]:   <metadata>
Aug 14 12:06:12 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:06:12 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:06:12 user nova-compute[73012]:       <nova:name>tempest-device-tagging-server-517741125</nova:name>
Aug 14 12:06:12 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:06:12</nova:creationTime>
Aug 14 12:06:12 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:06:12 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:06:12 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:06:12 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:06:12 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:06:12 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:06:12 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:06:12 user nova-compute[73012]:       <nova:owner>
Aug 14 12:06:12 user nova-compute[73012]:         <nova:user uuid="7bd40979075344b28d0223d4b5084508">tempest-TaggedAttachmentsTest-1305129888-project-member</nova:user>
Aug 14 12:06:12 user nova-compute[73012]:         <nova:project uuid="a60f4140fa9e464ba556f644132aad96">tempest-TaggedAttachmentsTest-1305129888</nova:project>
Aug 14 12:06:12 user nova-compute[73012]:       </nova:owner>
Aug 14 12:06:12 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:06:12 user nova-compute[73012]:       <nova:ports>
Aug 14 12:06:12 user nova-compute[73012]:         <nova:port uuid="30ec13f3-55af-4216-a06e-63bc7b1fb9b6">
Aug 14 12:06:12 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:06:12 user nova-compute[73012]:         </nova:port>
Aug 14 12:06:12 user nova-compute[73012]:       </nova:ports>
Aug 14 12:06:12 user nova-compute[73012]:     </nova:instance>
Aug 14 12:06:12 user nova-compute[73012]:   </metadata>
Aug 14 12:06:12 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:06:12 user nova-compute[73012]:     <system>
Aug 14 12:06:12 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:06:12 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:06:12 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:06:12 user nova-compute[73012]:       <entry name="serial">96b9a98d-d416-40ef-aa85-ce23ad77e9d7</entry>
Aug 14 12:06:12 user nova-compute[73012]:       <entry name="uuid">96b9a98d-d416-40ef-aa85-ce23ad77e9d7</entry>
Aug 14 12:06:12 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:06:12 user nova-compute[73012]:     </system>
Aug 14 12:06:12 user nova-compute[73012]:   </sysinfo>
Aug 14 12:06:12 user nova-compute[73012]:   <os>
Aug 14 12:06:12 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:06:12 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:06:12 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:06:12 user nova-compute[73012]:   </os>
Aug 14 12:06:12 user nova-compute[73012]:   <features>
Aug 14 12:06:12 user nova-compute[73012]:     <acpi/>
Aug 14 12:06:12 user nova-compute[73012]:     <apic/>
Aug 14 12:06:12 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:06:12 user nova-compute[73012]:   </features>
Aug 14 12:06:12 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:06:12 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:06:12 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:06:12 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:06:12 user nova-compute[73012]:   </clock>
Aug 14 12:06:12 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:06:12 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:06:12 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:06:12 user nova-compute[73012]:   </cpu>
Aug 14 12:06:12 user nova-compute[73012]:   <devices>
Aug 14 12:06:12 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:06:12 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:06:12 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk"/>
Aug 14 12:06:12 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:06:12 user nova-compute[73012]:     </disk>
Aug 14 12:06:12 user nova-compute[73012]:     <disk type="file" device="cdrom">
Aug 14 12:06:12 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 12:06:12 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk.config"/>
Aug 14 12:06:12 user nova-compute[73012]:       <target dev="hda" bus="ide"/>
Aug 14 12:06:12 user nova-compute[73012]:     </disk>
Aug 14 12:06:12 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:06:12 user nova-compute[73012]:       <mac address="fa:16:3e:a2:ae:c8"/>
Aug 14 12:06:12 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:06:12 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:06:12 user nova-compute[73012]:       <target dev="tap30ec13f3-55"/>
Aug 14 12:06:12 user nova-compute[73012]:     </interface>
Aug 14 12:06:12 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:06:12 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/console.log" append="off"/>
Aug 14 12:06:12 user nova-compute[73012]:     </serial>
Aug 14 12:06:12 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:06:12 user nova-compute[73012]:     <video>
Aug 14 12:06:12 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:06:12 user nova-compute[73012]:     </video>
Aug 14 12:06:12 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:06:12 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:06:12 user nova-compute[73012]:     </rng>
Aug 14 12:06:12 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:06:12 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:06:12 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:06:12 user nova-compute[73012]:     </memballoon>
Aug 14 12:06:12 user nova-compute[73012]:   </devices>
Aug 14 12:06:12 user nova-compute[73012]: </domain>
Aug 14 12:06:12 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517741125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517741125',id=8,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2TTpmfaQPgY9ohNbVadAHJOLiNi1lPNazCQ0/vgYaopsQex8HgTVtrzr1PsGl+iZ8XzkXNAGaX1YvJAn1t8iAMrG6pCLvmKBNfbkLxAoKRO+zDopEQxka9+HZl/6dPMQ==',key_name='tempest-keypair-779145758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a60f4140fa9e464ba556f644132aad96',ramdisk_id='',reservation_id='r-7nj3lvpu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1305129888',owner_user_name='tempest-TaggedAttachmentsTest-1305129888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd40979075344b28d0223d4b5084508',uuid=96b9a98d-d416-40ef-aa85-ce23ad77e9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converting VIF {"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=30ec13f3-55af-4216-a06e-63bc7b1fb9b6,network=Network(afb0b1b7-00d0-4088-a3d4-2b0a7323d79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30ec13f3-55') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG os_vif [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=30ec13f3-55af-4216-a06e-63bc7b1fb9b6,network=Network(afb0b1b7-00d0-4088-a3d4-2b0a7323d79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30ec13f3-55') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30ec13f3-55, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30ec13f3-55, col_values=(('external_ids', {'iface-id': '30ec13f3-55af-4216-a06e-63bc7b1fb9b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:ae:c8', 'vm-uuid': '96b9a98d-d416-40ef-aa85-ce23ad77e9d7'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:12 user nova-compute[73012]: INFO os_vif [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=30ec13f3-55af-4216-a06e-63bc7b1fb9b6,network=Network(afb0b1b7-00d0-4088-a3d4-2b0a7323d79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30ec13f3-55')
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] No BDM found with device name hda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] No VIF found with MAC fa:16:3e:a2:ae:c8, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:06:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Using config drive
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received event network-vif-plugged-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] No waiting events found dispatching network-vif-plugged-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:12 user nova-compute[73012]: WARNING nova.compute.manager [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received unexpected event network-vif-plugged-04bdd88d-db33-48f1-8154-b4fec28a16cf for instance with vm_state building and task_state spawning.
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-changed-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Refreshing instance network info cache due to event network-changed-30ec13f3-55af-4216-a06e-63bc7b1fb9b6. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] Acquiring lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] Acquired lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Refreshing network info cache for port 30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Creating config drive at /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk.config
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4zk4bcy2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4zk4bcy2" returned: 0 in 0.070s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updated VIF entry in instance network info cache for port 30ec13f3-55af-4216-a06e-63bc7b1fb9b6. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:06:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updating instance_info_cache with network_info: [{"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:06:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-70c314a2-cdf9-4d09-9a72-785fb1a50e91 req-a12fb3d5-a24b-41ae-9b8b-bd3a0077d3ba service nova] Releasing lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:06:13 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014773.8920176, e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:06:13 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] VM Resumed (Lifecycle Event)
Aug 14 12:06:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:06:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:06:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:13 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Instance spawned successfully.
Aug 14 12:06:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:06:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:06:13 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:06:13 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014773.9125192, e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:06:13 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] VM Started (Lifecycle Event)
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-35a46b40-1375-4ce1-9feb-5305e7cb316f req-2e501710-0c63-4237-88a3-8b6625e1a112 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received event network-vif-plugged-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-35a46b40-1375-4ce1-9feb-5305e7cb316f req-2e501710-0c63-4237-88a3-8b6625e1a112 service nova] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-35a46b40-1375-4ce1-9feb-5305e7cb316f req-2e501710-0c63-4237-88a3-8b6625e1a112 service nova] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-35a46b40-1375-4ce1-9feb-5305e7cb316f req-2e501710-0c63-4237-88a3-8b6625e1a112 service nova] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-35a46b40-1375-4ce1-9feb-5305e7cb316f req-2e501710-0c63-4237-88a3-8b6625e1a112 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] No waiting events found dispatching network-vif-plugged-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:14 user nova-compute[73012]: WARNING nova.compute.manager [req-35a46b40-1375-4ce1-9feb-5305e7cb316f req-2e501710-0c63-4237-88a3-8b6625e1a112 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received unexpected event network-vif-plugged-fce00ee4-2792-4ba8-b784-985ba783b386 for instance with vm_state building and task_state spawning.
Aug 14 12:06:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Took 10.67 seconds to spawn the instance on the hypervisor.
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014774.336656, ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] VM Resumed (Lifecycle Event)
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Instance spawned successfully.
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014774.3399093, ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] VM Started (Lifecycle Event)
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.compute.manager [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Took 12.42 seconds to build instance.
Aug 14 12:06:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-743ac9eb-68eb-437c-a482-19f061be9559 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.744s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Took 9.68 seconds to spawn the instance on the hypervisor.
Aug 14 12:06:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:14 user nova-compute[73012]: INFO nova.compute.manager [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Took 11.49 seconds to build instance.
Aug 14 12:06:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ff255275-b3ce-4a17-afe7-88090af15cd5 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.883s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-plugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] No waiting events found dispatching network-vif-plugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:16 user nova-compute[73012]: WARNING nova.compute.manager [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received unexpected event network-vif-plugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 for instance with vm_state building and task_state spawning.
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-plugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] No waiting events found dispatching network-vif-plugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:16 user nova-compute[73012]: WARNING nova.compute.manager [req-2abb769b-a33a-4242-82cc-97d393bfdce6 req-d53619c5-1c1a-4aa5-b0a5-a6ec05e5de6b service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received unexpected event network-vif-plugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 for instance with vm_state building and task_state spawning.
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014776.9247239, 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:06:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] VM Resumed (Lifecycle Event)
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:06:16 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Instance spawned successfully.
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:06:17 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:06:17 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014776.9292214, 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:06:17 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] VM Started (Lifecycle Event)
Aug 14 12:06:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:06:17 user nova-compute[73012]: INFO nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Took 8.60 seconds to spawn the instance on the hypervisor.
Aug 14 12:06:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:17 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:06:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:17 user nova-compute[73012]: INFO nova.compute.manager [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Took 10.36 seconds to build instance.
Aug 14 12:06:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-08d5a1ed-3ce5-4adf-b8b2-a405ada24cb8 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.610s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:06:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:06:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:06:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:21 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:06:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:26 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:26 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7672MB free_disk=25.89914321899414GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9cca8a9c-127f-44ab-9acd-3ebc43323c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4c2979a7-addd-4746-be89-9e5cad4cae3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 273c3cd7-3897-4079-821b-b477102fd7ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:06:26 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:06:27 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:06:27 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:06:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:27 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:06:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.061s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-9cca8a9c-127f-44ab-9acd-3ebc43323c6e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-9cca8a9c-127f-44ab-9acd-3ebc43323c6e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 9cca8a9c-127f-44ab-9acd-3ebc43323c6e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Updating instance_info_cache with network_info: [{"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-9cca8a9c-127f-44ab-9acd-3ebc43323c6e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:06:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:06:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:06:46 user nova-compute[73012]: INFO nova.compute.claims [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Claim successful on node user
Aug 14 12:06:46 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:06:46 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:06:47 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:06:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:06:47 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Creating image(s)
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "/opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "/opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "/opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG nova.policy [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a52866e21ac4407eb3004b69a38ce75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abf0cec2b9b4977ba86d806058ec6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.216s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk 1073741824" returned: 0 in 0.050s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:06:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Successfully created port: 22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Cannot resize image /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lazy-loading 'migration_context' on Instance uuid 76214f3b-ceb8-4443-b70e-1dc6e0a11217 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Ensure instance console log exists: /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Successfully updated port: 22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "refresh_cache-76214f3b-ceb8-4443-b70e-1dc6e0a11217" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquired lock "refresh_cache-76214f3b-ceb8-4443-b70e-1dc6e0a11217" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-b3a63f15-0a9e-436c-a42e-da0f2fba04a8 req-ef6ae58f-495b-40b4-97f7-a5be63bbb30f service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received event network-changed-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-b3a63f15-0a9e-436c-a42e-da0f2fba04a8 req-ef6ae58f-495b-40b4-97f7-a5be63bbb30f service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Refreshing instance network info cache due to event network-changed-22b08e63-95c9-42e4-9c73-b99cbb8cf21b. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b3a63f15-0a9e-436c-a42e-da0f2fba04a8 req-ef6ae58f-495b-40b4-97f7-a5be63bbb30f service nova] Acquiring lock "refresh_cache-76214f3b-ceb8-4443-b70e-1dc6e0a11217" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Updating instance_info_cache with network_info: [{"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Releasing lock "refresh_cache-76214f3b-ceb8-4443-b70e-1dc6e0a11217" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Instance network_info: |[{"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b3a63f15-0a9e-436c-a42e-da0f2fba04a8 req-ef6ae58f-495b-40b4-97f7-a5be63bbb30f service nova] Acquired lock "refresh_cache-76214f3b-ceb8-4443-b70e-1dc6e0a11217" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.network.neutron [req-b3a63f15-0a9e-436c-a42e-da0f2fba04a8 req-ef6ae58f-495b-40b4-97f7-a5be63bbb30f service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Refreshing network info cache for port 22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:06:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Start _get_guest_xml network_info=[{"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:06:48 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:48 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-768619710',display_name='tempest-VolumesActionsTest-instance-768619710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-768619710',id=9,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5abf0cec2b9b4977ba86d806058ec6df',ramdisk_id='',reservation_id='r-0903ggsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-793579565',owner_user_name='tempest-VolumesActionsTest-793579565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:06:47Z,user_data=None,user_id='a52866e21ac4407eb3004b69a38ce75b',uuid=76214f3b-ceb8-4443-b70e-1dc6e0a11217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converting VIF {"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:e0,bridge_name='br-int',has_traffic_filtering=True,id=22b08e63-95c9-42e4-9c73-b99cbb8cf21b,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b08e63-95') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lazy-loading 'pci_devices' on Instance uuid 76214f3b-ceb8-4443-b70e-1dc6e0a11217 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:06:49 user nova-compute[73012]:   <uuid>76214f3b-ceb8-4443-b70e-1dc6e0a11217</uuid>
Aug 14 12:06:49 user nova-compute[73012]:   <name>instance-00000009</name>
Aug 14 12:06:49 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:06:49 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:06:49 user nova-compute[73012]:   <metadata>
Aug 14 12:06:49 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:06:49 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:06:49 user nova-compute[73012]:       <nova:name>tempest-VolumesActionsTest-instance-768619710</nova:name>
Aug 14 12:06:49 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:06:48</nova:creationTime>
Aug 14 12:06:49 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:06:49 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:06:49 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:06:49 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:06:49 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:06:49 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:06:49 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:06:49 user nova-compute[73012]:       <nova:owner>
Aug 14 12:06:49 user nova-compute[73012]:         <nova:user uuid="a52866e21ac4407eb3004b69a38ce75b">tempest-VolumesActionsTest-793579565-project-member</nova:user>
Aug 14 12:06:49 user nova-compute[73012]:         <nova:project uuid="5abf0cec2b9b4977ba86d806058ec6df">tempest-VolumesActionsTest-793579565</nova:project>
Aug 14 12:06:49 user nova-compute[73012]:       </nova:owner>
Aug 14 12:06:49 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:06:49 user nova-compute[73012]:       <nova:ports>
Aug 14 12:06:49 user nova-compute[73012]:         <nova:port uuid="22b08e63-95c9-42e4-9c73-b99cbb8cf21b">
Aug 14 12:06:49 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 12:06:49 user nova-compute[73012]:         </nova:port>
Aug 14 12:06:49 user nova-compute[73012]:       </nova:ports>
Aug 14 12:06:49 user nova-compute[73012]:     </nova:instance>
Aug 14 12:06:49 user nova-compute[73012]:   </metadata>
Aug 14 12:06:49 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:06:49 user nova-compute[73012]:     <system>
Aug 14 12:06:49 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:06:49 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:06:49 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:06:49 user nova-compute[73012]:       <entry name="serial">76214f3b-ceb8-4443-b70e-1dc6e0a11217</entry>
Aug 14 12:06:49 user nova-compute[73012]:       <entry name="uuid">76214f3b-ceb8-4443-b70e-1dc6e0a11217</entry>
Aug 14 12:06:49 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:06:49 user nova-compute[73012]:     </system>
Aug 14 12:06:49 user nova-compute[73012]:   </sysinfo>
Aug 14 12:06:49 user nova-compute[73012]:   <os>
Aug 14 12:06:49 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:06:49 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:06:49 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:06:49 user nova-compute[73012]:   </os>
Aug 14 12:06:49 user nova-compute[73012]:   <features>
Aug 14 12:06:49 user nova-compute[73012]:     <acpi/>
Aug 14 12:06:49 user nova-compute[73012]:     <apic/>
Aug 14 12:06:49 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:06:49 user nova-compute[73012]:   </features>
Aug 14 12:06:49 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:06:49 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:06:49 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:06:49 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:06:49 user nova-compute[73012]:   </clock>
Aug 14 12:06:49 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:06:49 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:06:49 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:06:49 user nova-compute[73012]:   </cpu>
Aug 14 12:06:49 user nova-compute[73012]:   <devices>
Aug 14 12:06:49 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:06:49 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:06:49 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk"/>
Aug 14 12:06:49 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:06:49 user nova-compute[73012]:     </disk>
Aug 14 12:06:49 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:06:49 user nova-compute[73012]:       <mac address="fa:16:3e:f3:53:e0"/>
Aug 14 12:06:49 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:06:49 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:06:49 user nova-compute[73012]:       <target dev="tap22b08e63-95"/>
Aug 14 12:06:49 user nova-compute[73012]:     </interface>
Aug 14 12:06:49 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:06:49 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/console.log" append="off"/>
Aug 14 12:06:49 user nova-compute[73012]:     </serial>
Aug 14 12:06:49 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:06:49 user nova-compute[73012]:     <video>
Aug 14 12:06:49 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:06:49 user nova-compute[73012]:     </video>
Aug 14 12:06:49 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:06:49 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:06:49 user nova-compute[73012]:     </rng>
Aug 14 12:06:49 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:06:49 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:06:49 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:06:49 user nova-compute[73012]:     </memballoon>
Aug 14 12:06:49 user nova-compute[73012]:   </devices>
Aug 14 12:06:49 user nova-compute[73012]: </domain>
Aug 14 12:06:49 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-768619710',display_name='tempest-VolumesActionsTest-instance-768619710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-768619710',id=9,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5abf0cec2b9b4977ba86d806058ec6df',ramdisk_id='',reservation_id='r-0903ggsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-793579565',owner_user_name='tempest-VolumesActionsTest-793579565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:06:47Z,user_data=None,user_id='a52866e21ac4407eb3004b69a38ce75b',uuid=76214f3b-ceb8-4443-b70e-1dc6e0a11217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converting VIF {"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:e0,bridge_name='br-int',has_traffic_filtering=True,id=22b08e63-95c9-42e4-9c73-b99cbb8cf21b,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b08e63-95') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG os_vif [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:e0,bridge_name='br-int',has_traffic_filtering=True,id=22b08e63-95c9-42e4-9c73-b99cbb8cf21b,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b08e63-95') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22b08e63-95, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22b08e63-95, col_values=(('external_ids', {'iface-id': '22b08e63-95c9-42e4-9c73-b99cbb8cf21b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:53:e0', 'vm-uuid': '76214f3b-ceb8-4443-b70e-1dc6e0a11217'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:49 user nova-compute[73012]: INFO os_vif [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:e0,bridge_name='br-int',has_traffic_filtering=True,id=22b08e63-95c9-42e4-9c73-b99cbb8cf21b,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b08e63-95')
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] No VIF found with MAC fa:16:3e:f3:53:e0, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.network.neutron [req-b3a63f15-0a9e-436c-a42e-da0f2fba04a8 req-ef6ae58f-495b-40b4-97f7-a5be63bbb30f service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Updated VIF entry in instance network info cache for port 22b08e63-95c9-42e4-9c73-b99cbb8cf21b. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG nova.network.neutron [req-b3a63f15-0a9e-436c-a42e-da0f2fba04a8 req-ef6ae58f-495b-40b4-97f7-a5be63bbb30f service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Updating instance_info_cache with network_info: [{"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b3a63f15-0a9e-436c-a42e-da0f2fba04a8 req-ef6ae58f-495b-40b4-97f7-a5be63bbb30f service nova] Releasing lock "refresh_cache-76214f3b-ceb8-4443-b70e-1dc6e0a11217" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:06:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-63ea34fc-7dae-4efc-aad5-02802379e2fb req-398f9bd3-9304-4cdd-a52d-94d250fd3c98 service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received event network-vif-plugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-63ea34fc-7dae-4efc-aad5-02802379e2fb req-398f9bd3-9304-4cdd-a52d-94d250fd3c98 service nova] Acquiring lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-63ea34fc-7dae-4efc-aad5-02802379e2fb req-398f9bd3-9304-4cdd-a52d-94d250fd3c98 service nova] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-63ea34fc-7dae-4efc-aad5-02802379e2fb req-398f9bd3-9304-4cdd-a52d-94d250fd3c98 service nova] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-63ea34fc-7dae-4efc-aad5-02802379e2fb req-398f9bd3-9304-4cdd-a52d-94d250fd3c98 service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] No waiting events found dispatching network-vif-plugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:50 user nova-compute[73012]: WARNING nova.compute.manager [req-63ea34fc-7dae-4efc-aad5-02802379e2fb req-398f9bd3-9304-4cdd-a52d-94d250fd3c98 service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received unexpected event network-vif-plugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b for instance with vm_state building and task_state spawning.
Aug 14 12:06:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014812.7531884, 76214f3b-ceb8-4443-b70e-1dc6e0a11217 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:06:52 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] VM Resumed (Lifecycle Event)
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:06:52 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Instance spawned successfully.
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-2a7a4fb9-0df5-4b50-8deb-db361467814e req-17e3fbf3-e181-4f46-9f3c-9b8acf3640a3 service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received event network-vif-plugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2a7a4fb9-0df5-4b50-8deb-db361467814e req-17e3fbf3-e181-4f46-9f3c-9b8acf3640a3 service nova] Acquiring lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2a7a4fb9-0df5-4b50-8deb-db361467814e req-17e3fbf3-e181-4f46-9f3c-9b8acf3640a3 service nova] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2a7a4fb9-0df5-4b50-8deb-db361467814e req-17e3fbf3-e181-4f46-9f3c-9b8acf3640a3 service nova] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-2a7a4fb9-0df5-4b50-8deb-db361467814e req-17e3fbf3-e181-4f46-9f3c-9b8acf3640a3 service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] No waiting events found dispatching network-vif-plugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:06:52 user nova-compute[73012]: WARNING nova.compute.manager [req-2a7a4fb9-0df5-4b50-8deb-db361467814e req-17e3fbf3-e181-4f46-9f3c-9b8acf3640a3 service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received unexpected event network-vif-plugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b for instance with vm_state building and task_state spawning.
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:06:52 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014812.7582853, 76214f3b-ceb8-4443-b70e-1dc6e0a11217 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:06:52 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] VM Started (Lifecycle Event)
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:06:52 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:06:52 user nova-compute[73012]: INFO nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 14 12:06:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:06:53 user nova-compute[73012]: INFO nova.compute.manager [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Took 6.54 seconds to build instance.
Aug 14 12:06:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3cdaafac-5cf7-47cd-8316-92cc07b70f46 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.632s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:06:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:06:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:07:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:07:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:07:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:07:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:07:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lazy-loading 'flavor' on Instance uuid 9cca8a9c-127f-44ab-9acd-3ebc43323c6e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:21 user nova-compute[73012]: INFO nova.compute.manager [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Attaching volume 10a83174-7bda-4042-8602-0d80dd406af5 to /dev/vdb
Aug 14 12:07:22 user nova-compute[73012]: DEBUG os_brick.utils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:22 user nova-compute[73012]: INFO oslo.privsep.daemon [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpoiyk2n_b/privsep.sock']
Aug 14 12:07:22 user sudo[84040]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpoiyk2n_b/privsep.sock
Aug 14 12:07:22 user sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 12:07:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:07:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:07:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:23 user sudo[84040]: pam_unix(sudo:session): session closed for user root
Aug 14 12:07:23 user nova-compute[73012]: INFO oslo.privsep.daemon [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Spawned new privsep daemon via rootwrap
Aug 14 12:07:23 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 12:07:23 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 12:07:23 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 14 12:07:23 user nova-compute[73012]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84070
Aug 14 12:07:23 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ec0f22-c539-45ad-9d13-1d71f73f8407]: (2,) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b288cb1-64fe-4018-8337-814382706bef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:24 user nova-compute[73012]: WARNING os_brick.initiator.connectors.nvmeof [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03da8fc-47ec-4ce8-8376-ad8c6ec13f9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6962268e-5d6c-409f-90d0-a392c8185d68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc7f60c-9ce0-4a9b-b734-95a5dfc23d64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:24 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81acc9e-1243-46c8-bb82-35f4f39fd630]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-4fb2ba37-2790-4adf-8ea2-5dedc1666f4d req-48f94878-2df3-45ff-a142-8a62ad280324 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-changed-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-4fb2ba37-2790-4adf-8ea2-5dedc1666f4d req-48f94878-2df3-45ff-a142-8a62ad280324 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Refreshing instance network info cache due to event network-changed-b32b1a3a-9a4c-4d1d-a455-5d249794cb62. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fb2ba37-2790-4adf-8ea2-5dedc1666f4d req-48f94878-2df3-45ff-a142-8a62ad280324 service nova] Acquiring lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fb2ba37-2790-4adf-8ea2-5dedc1666f4d req-48f94878-2df3-45ff-a142-8a62ad280324 service nova] Acquired lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG nova.network.neutron [req-4fb2ba37-2790-4adf-8ea2-5dedc1666f4d req-48f94878-2df3-45ff-a142-8a62ad280324 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Refreshing network info cache for port b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG os_brick.utils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] <== get_connector_properties: return (2262ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Updating existing volume attachment record: b18d72ff-8564-4b34-b874-a4a8a09f463a {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-4fb2ba37-2790-4adf-8ea2-5dedc1666f4d req-48f94878-2df3-45ff-a142-8a62ad280324 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updated VIF entry in instance network info cache for port b32b1a3a-9a4c-4d1d-a455-5d249794cb62. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-4fb2ba37-2790-4adf-8ea2-5dedc1666f4d req-48f94878-2df3-45ff-a142-8a62ad280324 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fb2ba37-2790-4adf-8ea2-5dedc1666f4d req-48f94878-2df3-45ff-a142-8a62ad280324 service nova] Releasing lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-b1f481fe-5bf2-40cf-ac13-190d77e5ab42 req-09e23698-520c-4fd7-a94a-e994c2625a54 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-changed-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-b1f481fe-5bf2-40cf-ac13-190d77e5ab42 req-09e23698-520c-4fd7-a94a-e994c2625a54 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Refreshing instance network info cache due to event network-changed-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b1f481fe-5bf2-40cf-ac13-190d77e5ab42 req-09e23698-520c-4fd7-a94a-e994c2625a54 service nova] Acquiring lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b1f481fe-5bf2-40cf-ac13-190d77e5ab42 req-09e23698-520c-4fd7-a94a-e994c2625a54 service nova] Acquired lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-b1f481fe-5bf2-40cf-ac13-190d77e5ab42 req-09e23698-520c-4fd7-a94a-e994c2625a54 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Refreshing network info cache for port decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-b1f481fe-5bf2-40cf-ac13-190d77e5ab42 req-09e23698-520c-4fd7-a94a-e994c2625a54 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updated VIF entry in instance network info cache for port decbb2a3-6f5c-48e3-a1ef-ee8237584aeb. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:07:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-b1f481fe-5bf2-40cf-ac13-190d77e5ab42 req-09e23698-520c-4fd7-a94a-e994c2625a54 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b1f481fe-5bf2-40cf-ac13-190d77e5ab42 req-09e23698-520c-4fd7-a94a-e994c2625a54 service nova] Releasing lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:07:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:27 user nova-compute[73012]: INFO nova.compute.manager [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] instance snapshotting
Aug 14 12:07:27 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Beginning live snapshot process
Aug 14 12:07:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:28 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:07:28 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=6981MB free_disk=25.770687103271484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json -f qcow2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9cca8a9c-127f-44ab-9acd-3ebc43323c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4c2979a7-addd-4746-be89-9e5cad4cae3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 273c3cd7-3897-4079-821b-b477102fd7ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 76214f3b-ceb8-4443-b70e-1dc6e0a11217 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json -f qcow2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpph1z87tt/fca99f7f427442e5b680c00ed181b6fe.delta 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpph1z87tt/fca99f7f427442e5b680c00ed181b6fe.delta 1073741824" returned: 0 in 0.057s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:29 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 12:07:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73012) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 14 12:07:29 user nova-compute[73012]: INFO nova.virt.libvirt.host [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] UEFI support detected
Aug 14 12:07:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:29 user nova-compute[73012]: INFO nova.compute.manager [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Shelving
Aug 14 12:07:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-84913a59-6359-4513-a1c4-cab0cff3ac50 req-bc37db3d-ee00-4c6c-824d-4cdd7c01b6a3 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-unplugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-84913a59-6359-4513-a1c4-cab0cff3ac50 req-bc37db3d-ee00-4c6c-824d-4cdd7c01b6a3 service nova] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-84913a59-6359-4513-a1c4-cab0cff3ac50 req-bc37db3d-ee00-4c6c-824d-4cdd7c01b6a3 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-84913a59-6359-4513-a1c4-cab0cff3ac50 req-bc37db3d-ee00-4c6c-824d-4cdd7c01b6a3 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-84913a59-6359-4513-a1c4-cab0cff3ac50 req-bc37db3d-ee00-4c6c-824d-4cdd7c01b6a3 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] No waiting events found dispatching network-vif-unplugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:07:29 user nova-compute[73012]: WARNING nova.compute.manager [req-84913a59-6359-4513-a1c4-cab0cff3ac50 req-bc37db3d-ee00-4c6c-824d-4cdd7c01b6a3 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received unexpected event network-vif-unplugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 for instance with vm_state active and task_state shelving.
Aug 14 12:07:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:07:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:07:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] COPY block job progress, current cursor: 21954560 final cursor: 75497472 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:07:30 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance destroyed successfully.
Aug 14 12:07:30 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Beginning cold snapshot process
Aug 14 12:07:30 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:07:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk /opt/stack/data/nova/instances/snapshots/tmphl8hzxms/e367fbbda2394b7c8cb65d17ffc49abd {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:07:30 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 12:07:30 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:07:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpph1z87tt/fca99f7f427442e5b680c00ed181b6fe.delta /opt/stack/data/nova/instances/snapshots/tmpph1z87tt/fca99f7f427442e5b680c00ed181b6fe {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpph1z87tt/fca99f7f427442e5b680c00ed181b6fe.delta /opt/stack/data/nova/instances/snapshots/tmpph1z87tt/fca99f7f427442e5b680c00ed181b6fe" returned: 0 in 0.645s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Snapshot extracted, beginning image upload
Aug 14 12:07:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk /opt/stack/data/nova/instances/snapshots/tmphl8hzxms/e367fbbda2394b7c8cb65d17ffc49abd" returned: 0 in 1.067s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Snapshot extracted, beginning image upload
Aug 14 12:07:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-bf6b31ae-d664-4621-8df4-3fa8b31b7226 req-bbfc6a91-5858-48f9-8119-69f6a1d1a371 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bf6b31ae-d664-4621-8df4-3fa8b31b7226 req-bbfc6a91-5858-48f9-8119-69f6a1d1a371 service nova] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bf6b31ae-d664-4621-8df4-3fa8b31b7226 req-bbfc6a91-5858-48f9-8119-69f6a1d1a371 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bf6b31ae-d664-4621-8df4-3fa8b31b7226 req-bbfc6a91-5858-48f9-8119-69f6a1d1a371 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-bf6b31ae-d664-4621-8df4-3fa8b31b7226 req-bbfc6a91-5858-48f9-8119-69f6a1d1a371 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] No waiting events found dispatching network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:07:31 user nova-compute[73012]: WARNING nova.compute.manager [req-bf6b31ae-d664-4621-8df4-3fa8b31b7226 req-bbfc6a91-5858-48f9-8119-69f6a1d1a371 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received unexpected event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 14 12:07:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connector [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Factory for ISCSI on None {{(pid=73012) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RajOdlmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:07:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:07:34 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:34 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Snapshot image upload complete
Aug 14 12:07:34 user nova-compute[73012]: INFO nova.compute.manager [None req-e344de00-e24e-473c-a60d-b08b0ef1b686 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Took 6.93 seconds to snapshot the instance on the hypervisor.
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd1307a-bb60-4a14-8a25-4ad31b74068b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:07:34 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4311d84d-72af-48f9-9b18-dd2164f9afc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5] added
Aug 14 12:07:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d062e1cc-df95-42d4-9092-eb04bbc0cbd6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e85e41-5251-48a6-ab83-612e34513f0b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RajOdlmP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RajOdlmP" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b180d7-9fe0-4743-9635-8d6f82c80df0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RajOdlmP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdb48ba-698d-4dbe-9512-e7aef2cf9e38]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:34 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Snapshot image upload complete
Aug 14 12:07:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dfc6d3-7709-4b00-9e94-583fd10865b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:07:34 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:07:34 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:07:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:07:34 user nova-compute[73012]: 
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:34 user nova-compute[73012]: INFO nova.compute.manager [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Shelve offloading
Aug 14 12:07:34 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance destroyed successfully.
Aug 14 12:07:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquired lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --login" returned: 0 in 0.375s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[58472581-5f49-415c-87e0-9f10deeb632a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5, portal: 172.16.0.220,3260]
Aug 14 12:07:35 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5, portal: 172.16.0.220,3260] successful.
Aug 14 12:07:35 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57086b-09ce-4ff0-92fc-0937c3c9bb51]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd77efc1-e13b-49ee-874d-0bb8f6c51242]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 (non-flash)
Aug 14 12:07:35 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 (non-flash)
Aug 14 12:07:35 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.672s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfb03f9-4e68-41ee-a19e-594905b34189]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG nova.network.neutron [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Releasing lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RajOdlmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.704s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] <== connect_volume: return (1706ms) {'type': 'block', 'scsi_wwn': '23032383839376264', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032383839376264', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lazy-loading 'flavor' on Instance uuid 9cca8a9c-127f-44ab-9acd-3ebc43323c6e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:07:36 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:07:36 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:07:36 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:07:36 user nova-compute[73012]:   <serial>10a83174-7bda-4042-8602-0d80dd406af5</serial>
Aug 14 12:07:36 user nova-compute[73012]: </disk>
Aug 14 12:07:36 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] No VIF found with MAC fa:16:3e:01:1d:2d, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:07:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-940ce909-96fc-465b-9393-df83f0424a76 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.847s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance destroyed successfully.
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'resources' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-504953000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-504953000',id=2,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWWx/ILh8Ns58c4RMDmnoFVw+ZxB5woQuR4Ai/Qbq5N2hQQNxo2Z4zYG11WGD0RkrLRIHbTYyq9giarhw3iS5T5OpyaaKY7mJ8oetC+zxpHsTL5Md9DwIWoSBSq3nhyQw==',key_name='tempest-keypair-2108541680',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:05:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-ie3t5afq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member',shelved_at='2023-08-14T12:07:34.678604',shelved_host='user',shelved_image_id='acaffae4-b3cb-4de7-8e96-4c8002f06be9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=4c2979a7-addd-4746-be89-9e5cad4cae3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG os_vif [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb32b1a3a-9a, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:07:37 user nova-compute[73012]: INFO os_vif [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a')
Aug 14 12:07:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Deleting instance files /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a_del
Aug 14 12:07:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Deletion of /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a_del complete
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-8f47c106-deef-48cf-a992-6282a8b35824 req-f3d650f4-127d-43d9-8601-c1d838ad6421 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-changed-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-8f47c106-deef-48cf-a992-6282a8b35824 req-f3d650f4-127d-43d9-8601-c1d838ad6421 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Refreshing instance network info cache due to event network-changed-b32b1a3a-9a4c-4d1d-a455-5d249794cb62. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8f47c106-deef-48cf-a992-6282a8b35824 req-f3d650f4-127d-43d9-8601-c1d838ad6421 service nova] Acquiring lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8f47c106-deef-48cf-a992-6282a8b35824 req-f3d650f4-127d-43d9-8601-c1d838ad6421 service nova] Acquired lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.network.neutron [req-8f47c106-deef-48cf-a992-6282a8b35824 req-f3d650f4-127d-43d9-8601-c1d838ad6421 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Refreshing network info cache for port b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:07:37 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Deleted allocations for instance 4c2979a7-addd-4746-be89-9e5cad4cae3a
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:37 user nova-compute[73012]: INFO nova.compute.manager [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Terminating instance
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04533078-0f11-4a57-8420-c4507ba86a1c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.576s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c9bef66-13cc-4056-bce9-4c72f8621de5 req-3a500e02-2c96-40f2-ace8-96970246420c service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received event network-vif-unplugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c9bef66-13cc-4056-bce9-4c72f8621de5 req-3a500e02-2c96-40f2-ace8-96970246420c service nova] Acquiring lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c9bef66-13cc-4056-bce9-4c72f8621de5 req-3a500e02-2c96-40f2-ace8-96970246420c service nova] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c9bef66-13cc-4056-bce9-4c72f8621de5 req-3a500e02-2c96-40f2-ace8-96970246420c service nova] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c9bef66-13cc-4056-bce9-4c72f8621de5 req-3a500e02-2c96-40f2-ace8-96970246420c service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] No waiting events found dispatching network-vif-unplugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c9bef66-13cc-4056-bce9-4c72f8621de5 req-3a500e02-2c96-40f2-ace8-96970246420c service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received event network-vif-unplugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.network.neutron [req-8f47c106-deef-48cf-a992-6282a8b35824 req-f3d650f4-127d-43d9-8601-c1d838ad6421 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updated VIF entry in instance network info cache for port b32b1a3a-9a4c-4d1d-a455-5d249794cb62. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.network.neutron [req-8f47c106-deef-48cf-a992-6282a8b35824 req-f3d650f4-127d-43d9-8601-c1d838ad6421 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:38 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Instance destroyed successfully.
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lazy-loading 'resources' on Instance uuid 9cca8a9c-127f-44ab-9acd-3ebc43323c6e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-524219684',display_name='tempest-DeleteServersTestJSON-server-524219684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-524219684',id=1,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acff498d08d64cd8850ee4cfe13b87ab',ramdisk_id='',reservation_id='r-ec6trpjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-673020177',owner_user_name='tempest-DeleteServersTestJSON-673020177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:05:41Z,user_data=None,user_id='b7704699c47d4d288028fc5e872157a5',uuid=9cca8a9c-127f-44ab-9acd-3ebc43323c6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Converting VIF {"id": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "address": "fa:16:3e:01:1d:2d", "network": {"id": "e45062b3-3db8-4280-8ae9-5f74a9f397ea", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-209657669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acff498d08d64cd8850ee4cfe13b87ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408a3ec8-bd", "ovs_interfaceid": "408a3ec8-bdfc-463f-98c4-5bc8e4397b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=408a3ec8-bdfc-463f-98c4-5bc8e4397b1c,network=Network(e45062b3-3db8-4280-8ae9-5f74a9f397ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap408a3ec8-bd') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_vif [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=408a3ec8-bdfc-463f-98c4-5bc8e4397b1c,network=Network(e45062b3-3db8-4280-8ae9-5f74a9f397ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap408a3ec8-bd') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8f47c106-deef-48cf-a992-6282a8b35824 req-f3d650f4-127d-43d9-8601-c1d838ad6421 service nova] Releasing lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap408a3ec8-bd, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:07:38 user nova-compute[73012]: INFO os_vif [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=408a3ec8-bdfc-463f-98c4-5bc8e4397b1c,network=Network(e45062b3-3db8-4280-8ae9-5f74a9f397ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap408a3ec8-bd')
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RajOdlmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:38 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[249360dc-6c32-4161-b515-5583b73eb25b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf2c95a-9875-435c-bcfa-b43b86e9ac4e]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 (non-flash)
Aug 14 12:07:38 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 (non-flash)
Aug 14 12:07:38 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9af0106170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[714072da-04f4-485b-9cb2-e9a9f7837e28]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dddfdee-0391-46ac-9d9e-a0d9eac2f684]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b53fc3-d8b5-4263-84f8-9bf0eba4309b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df217c1-1548-4fe6-b35d-c72d4c42b7bc]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[514444e4-2e37-4cfa-b298-c82b359e8b15]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddc380e-9559-462a-831d-00c47d8ab67f]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5, portal: 172.16.0.220,3260]
Aug 14 12:07:38 user nova-compute[73012]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5, portal: 172.16.0.220,3260] successful.
Aug 14 12:07:38 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a83174-7bda-4042-8602-0d80dd406af5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9153ed-c6cc-4778-b934-11addaa16fdb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] <== disconnect_volume: return (292ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:07:38 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Deleting instance files /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e_del
Aug 14 12:07:38 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Deletion of /opt/stack/data/nova/instances/9cca8a9c-127f-44ab-9acd-3ebc43323c6e_del complete
Aug 14 12:07:38 user nova-compute[73012]: INFO nova.compute.manager [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 14 12:07:38 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:07:38 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-bf99cb12-c189-4ad4-8a01-c801e2e69387 req-92d059d0-2ba4-44be-95ba-dc118cecc93f service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received event network-changed-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-bf99cb12-c189-4ad4-8a01-c801e2e69387 req-92d059d0-2ba4-44be-95ba-dc118cecc93f service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Refreshing instance network info cache due to event network-changed-b5e8f694-10fa-4e20-9f7f-6f2336be289e. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bf99cb12-c189-4ad4-8a01-c801e2e69387 req-92d059d0-2ba4-44be-95ba-dc118cecc93f service nova] Acquiring lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bf99cb12-c189-4ad4-8a01-c801e2e69387 req-92d059d0-2ba4-44be-95ba-dc118cecc93f service nova] Acquired lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG nova.network.neutron [req-bf99cb12-c189-4ad4-8a01-c801e2e69387 req-92d059d0-2ba4-44be-95ba-dc118cecc93f service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Refreshing network info cache for port b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:39 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Took 0.59 seconds to deallocate network for instance.
Aug 14 12:07:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-6b162429-78ff-422d-88f9-3e3e72da509a req-919629f2-5b04-4cfe-9463-ae68f867267b service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received event network-vif-deleted-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG nova.network.neutron [req-bf99cb12-c189-4ad4-8a01-c801e2e69387 req-92d059d0-2ba4-44be-95ba-dc118cecc93f service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Updated VIF entry in instance network info cache for port b5e8f694-10fa-4e20-9f7f-6f2336be289e. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG nova.network.neutron [req-bf99cb12-c189-4ad4-8a01-c801e2e69387 req-92d059d0-2ba4-44be-95ba-dc118cecc93f service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Updating instance_info_cache with network_info: [{"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bf99cb12-c189-4ad4-8a01-c801e2e69387 req-92d059d0-2ba4-44be-95ba-dc118cecc93f service nova] Releasing lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:40 user nova-compute[73012]: INFO nova.compute.manager [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Took 0.85 seconds to detach 1 volumes for instance.
Aug 14 12:07:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received event network-vif-plugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] Acquiring lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] No waiting events found dispatching network-vif-plugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:07:40 user nova-compute[73012]: WARNING nova.compute.manager [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Received unexpected event network-vif-plugged-408a3ec8-bdfc-463f-98c4-5bc8e4397b1c for instance with vm_state deleted and task_state None.
Aug 14 12:07:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received event network-changed-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Refreshing instance network info cache due to event network-changed-6ce711be-e9df-4d5b-9df7-4a039750507d. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] Acquiring lock "refresh_cache-273c3cd7-3897-4079-821b-b477102fd7ba" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] Acquired lock "refresh_cache-273c3cd7-3897-4079-821b-b477102fd7ba" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG nova.network.neutron [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Refreshing network info cache for port 6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:07:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:40 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Deleted allocations for instance 9cca8a9c-127f-44ab-9acd-3ebc43323c6e
Aug 14 12:07:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcde5f63-67fb-4f88-b169-4fdcdf3a06c7 tempest-DeleteServersTestJSON-673020177 tempest-DeleteServersTestJSON-673020177-project-member] Lock "9cca8a9c-127f-44ab-9acd-3ebc43323c6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.265s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:41 user nova-compute[73012]: DEBUG nova.network.neutron [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Updated VIF entry in instance network info cache for port 6ce711be-e9df-4d5b-9df7-4a039750507d. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:07:41 user nova-compute[73012]: DEBUG nova.network.neutron [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Updating instance_info_cache with network_info: [{"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ee83c47a-ea09-40c8-b8e3-c667e79377e7 req-702611a3-0f7d-4987-bf73-b8edebef80f8 service nova] Releasing lock "refresh_cache-273c3cd7-3897-4079-821b-b477102fd7ba" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:42 user nova-compute[73012]: DEBUG nova.objects.instance [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lazy-loading 'flavor' on Instance uuid 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:43 user nova-compute[73012]: INFO nova.compute.manager [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Attaching volume 058ade2f-1121-4b94-b14b-57f74f70d4b9 to /dev/vdb
Aug 14 12:07:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG os_brick.utils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0f7a3d-06ef-4e3b-98f6-12d06fd49c78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c235c6cf-7959-4dd8-98a1-24de611ce779]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc470e52-1011-4ee8-ae87-cdbfcee9286e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[73308c51-fb2d-4c54-b423-0edc5eb8f42a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:43 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:07:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fed764-3486-4557-8bb3-d7b7e84cdf5a]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG os_brick.utils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:43 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Updating existing volume attachment record: 05dd84a0-b3fa-4c8f-9297-beda83d05f9c {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lazy-loading 'flavor' on Instance uuid 273c3cd7-3897-4079-821b-b477102fd7ba {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:44 user nova-compute[73012]: INFO nova.compute.manager [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Attaching volume 6960cfc0-fe79-43b5-aa6e-871adcd0fc48 to /dev/sdc
Aug 14 12:07:44 user nova-compute[73012]: DEBUG os_brick.utils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52fd80c-2935-4e76-9231-376fbbdb00ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b252ba-9fbf-4dff-a83e-43becf74a883]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0810ca08-3ad5-4511-8bd4-c02e2fd4778e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[db41f084-e9b9-4ee6-b233-6e1a4530598d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:45 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:07:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[452611dd-71d7-403f-beec-e1eba0018a04]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG os_brick.utils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Updating existing volume attachment record: 18eee7e3-182c-44d3-bd12-06ac9fd92577 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:07:45 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692014850.4468753, 4c2979a7-addd-4746-be89-9e5cad4cae3a => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:07:45 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] VM Stopped (Lifecycle Event)
Aug 14 12:07:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-dd811ed1-3352-4e49-9393-a99536dbe6d5 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:07:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:07:51 user nova-compute[73012]: INFO nova.compute.claims [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Claim successful on node user
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:07:51 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:07:51 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Creating image(s)
Aug 14 12:07:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "/opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "/opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "/opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:51 user nova-compute[73012]: DEBUG nova.policy [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5835e834cb846f795b3f13fa68bbec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fb585a888b4a7499315cd87da2c315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.212s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.206s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk 1073741824" returned: 0 in 0.061s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.215s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Checking if we can resize image /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AscrEGMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:52 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:07:52 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:07:52 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[58731e9b-fede-4010-84bb-0360bec93827]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:07:52 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9175a0-75fd-49d5-b1bb-41e925993cd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9] added
Aug 14 12:07:52 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[11932d52-0190-446a-890a-143dd8a0e852]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Cannot resize image /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG nova.objects.instance [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lazy-loading 'migration_context' on Instance uuid 155f4cf4-3bfd-4529-bb26-529a500e61eb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7279274-aa7c-496e-be19-eb522e5fd20a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AscrEGMt {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG nova.network.neutron [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Successfully created port: 26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Ensure instance console log exists: /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AscrEGMt" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b7e63b-4867-499a-b29b-470a79acb585]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AscrEGMt'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7774c07-d9df-40c5-943a-4d484f18129a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb78719-19e9-4978-ae91-0cc0af55ad68]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:07:52 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:07:52 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:07:52 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:07:52 user nova-compute[73012]: 
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a6b6d0-dc18-4de2-8490-adcad74f0aa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9, portal: 172.16.0.220,3260]
Aug 14 12:07:52 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9, portal: 172.16.0.220,3260] successful.
Aug 14 12:07:52 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5742466-9389-46d9-a3e0-e5b66fefcfa5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eea5ab-08a0-45e4-ad2f-e3b3f732d790]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)
Aug 14 12:07:52 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)
Aug 14 12:07:52 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:07:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e13031-6048-485a-8af7-580184e49fdc]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AscrEGMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692014858.310693, 9cca8a9c-127f-44ab-9acd-3ebc43323c6e => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:07:53 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] VM Stopped (Lifecycle Event)
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-806b2a7b-19af-4a46-95e4-4f9da9c8812e None None] [instance: 9cca8a9c-127f-44ab-9acd-3ebc43323c6e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a7fc6f2-e18c-4701-8100-2fc5bc9f6d8c req-3f58ba1c-0ac1-4244-ab87-17caf42cb5f1 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received event network-changed-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a7fc6f2-e18c-4701-8100-2fc5bc9f6d8c req-3f58ba1c-0ac1-4244-ab87-17caf42cb5f1 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Refreshing instance network info cache due to event network-changed-04bdd88d-db33-48f1-8154-b4fec28a16cf. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a7fc6f2-e18c-4701-8100-2fc5bc9f6d8c req-3f58ba1c-0ac1-4244-ab87-17caf42cb5f1 service nova] Acquiring lock "refresh_cache-e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a7fc6f2-e18c-4701-8100-2fc5bc9f6d8c req-3f58ba1c-0ac1-4244-ab87-17caf42cb5f1 service nova] Acquired lock "refresh_cache-e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.network.neutron [req-7a7fc6f2-e18c-4701-8100-2fc5bc9f6d8c req-3f58ba1c-0ac1-4244-ab87-17caf42cb5f1 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Refreshing network info cache for port 04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Successfully updated port: 26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "refresh_cache-155f4cf4-3bfd-4529-bb26-529a500e61eb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquired lock "refresh_cache-155f4cf4-3bfd-4529-bb26-529a500e61eb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lazy-loading 'flavor' on Instance uuid e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-54607ff9-02d6-4c98-ba0f-9642865f879f req-08af9215-7fc5-44a0-944f-1be9580eb373 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received event network-changed-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-54607ff9-02d6-4c98-ba0f-9642865f879f req-08af9215-7fc5-44a0-944f-1be9580eb373 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Refreshing instance network info cache due to event network-changed-26881dfb-9732-4375-a667-098ca8538791. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54607ff9-02d6-4c98-ba0f-9642865f879f req-08af9215-7fc5-44a0-944f-1be9580eb373 service nova] Acquiring lock "refresh_cache-155f4cf4-3bfd-4529-bb26-529a500e61eb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.network.neutron [req-7a7fc6f2-e18c-4701-8100-2fc5bc9f6d8c req-3f58ba1c-0ac1-4244-ab87-17caf42cb5f1 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Updated VIF entry in instance network info cache for port 04bdd88d-db33-48f1-8154-b4fec28a16cf. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:07:53 user nova-compute[73012]: DEBUG nova.network.neutron [req-7a7fc6f2-e18c-4701-8100-2fc5bc9f6d8c req-3f58ba1c-0ac1-4244-ab87-17caf42cb5f1 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Updating instance_info_cache with network_info: [{"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23130396433386163', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130396433386163', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.objects.instance [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lazy-loading 'flavor' on Instance uuid 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a7fc6f2-e18c-4701-8100-2fc5bc9f6d8c req-3f58ba1c-0ac1-4244-ab87-17caf42cb5f1 service nova] Releasing lock "refresh_cache-e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:07:54 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:07:54 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:07:54 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:07:54 user nova-compute[73012]:   <serial>058ade2f-1121-4b94-b14b-57f74f70d4b9</serial>
Aug 14 12:07:54 user nova-compute[73012]: </disk>
Aug 14 12:07:54 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:54 user nova-compute[73012]: INFO nova.compute.manager [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Attaching volume 934acbf6-2cf1-47f3-8f62-86e54a8b8eef to /dev/vdb
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.utils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5194e223-67c3-4fbe-8ede-4fa6dcbf384d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6159c7-d4af-4cec-9428-dfb3f3ca07c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb16419-7412-4b71-be45-58354714cdfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0af9f13-a265-4c51-acf9-709852840734]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:54 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd052af-f7ff-4e0a-9629-48eabba7030e]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.utils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Updating existing volume attachment record: 39e4466a-8238-4fbb-ba08-377042f8da13 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akFrtoun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:54 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:07:54 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:07:54 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22223d1-2de8-4e13-bcd7-448e984d36f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:07:54 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] No VIF found with MAC fa:16:3e:79:4e:b2, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c7966d-690e-4c7f-bb0f-1fb7222b265e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48] added
Aug 14 12:07:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f9de81-3fa5-42ca-9d4d-96fe0cb0af24]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8199dbc9-53eb-4fa1-ab43-b8b62f05def5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akFrtoun {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akFrtoun" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d600ad1-264a-4a20-be5a-dd24d1ec58b0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'akFrtoun'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Updating instance_info_cache with network_info: [{"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc014c4-7b2a-4d39-8d9f-56667f76f5e9]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Releasing lock "refresh_cache-155f4cf4-3bfd-4529-bb26-529a500e61eb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Instance network_info: |[{"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54607ff9-02d6-4c98-ba0f-9642865f879f req-08af9215-7fc5-44a0-944f-1be9580eb373 service nova] Acquired lock "refresh_cache-155f4cf4-3bfd-4529-bb26-529a500e61eb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.network.neutron [req-54607ff9-02d6-4c98-ba0f-9642865f879f req-08af9215-7fc5-44a0-944f-1be9580eb373 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Refreshing network info cache for port 26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Start _get_guest_xml network_info=[{"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0071667-acd9-4599-b167-5e843676ac3e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)
Aug 14 12:07:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)
Aug 14 12:07:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:07:54 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-789983f5-9df8-4c2b-91f6-2218760d7e2d tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.593s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-125341889',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-125341889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1253418',id=10,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+9Udl1ar2EtSlZ55/X2JbVR8IG+gv303XaT36DX1mMay+ahtNoBoibmnnYPvNoz7TabC0d8aP03/ndlyBYdUHgDty31rPT5Lk9liKtvN9OO/9dKzHipifKuhGOsU+/Bg==',key_name='tempest-keypair-1621558607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54fb585a888b4a7499315cd87da2c315',ramdisk_id='',reservation_id='r-mg2y5t0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1660840996',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5835e834cb846f795b3f13fa68bbec0',uuid=155f4cf4-3bfd-4529-bb26-529a500e61eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Converting VIF {"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e1:26,bridge_name='br-int',has_traffic_filtering=True,id=26881dfb-9732-4375-a667-098ca8538791,network=Network(c587c329-76aa-485a-837b-f751cd67bdb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26881dfb-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.objects.instance [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lazy-loading 'pci_devices' on Instance uuid 155f4cf4-3bfd-4529-bb26-529a500e61eb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57fa303-a3d9-4497-84de-b7ea11dd7ec1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48, portal: 172.16.0.220,3260]
Aug 14 12:07:54 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48, portal: 172.16.0.220,3260] successful.
Aug 14 12:07:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:07:54 user nova-compute[73012]:   <uuid>155f4cf4-3bfd-4529-bb26-529a500e61eb</uuid>
Aug 14 12:07:54 user nova-compute[73012]:   <name>instance-0000000a</name>
Aug 14 12:07:54 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:07:54 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:07:54 user nova-compute[73012]:   <metadata>
Aug 14 12:07:54 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:07:54 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:07:54 user nova-compute[73012]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-125341889</nova:name>
Aug 14 12:07:54 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:07:54</nova:creationTime>
Aug 14 12:07:54 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:07:54 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:07:54 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:07:54 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:07:54 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:07:54 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:07:54 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:07:54 user nova-compute[73012]:       <nova:owner>
Aug 14 12:07:54 user nova-compute[73012]:         <nova:user uuid="c5835e834cb846f795b3f13fa68bbec0">tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member</nova:user>
Aug 14 12:07:54 user nova-compute[73012]:         <nova:project uuid="54fb585a888b4a7499315cd87da2c315">tempest-TestServerVolumeAttachScenarioOldVersion-1660840996</nova:project>
Aug 14 12:07:54 user nova-compute[73012]:       </nova:owner>
Aug 14 12:07:54 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:07:54 user nova-compute[73012]:       <nova:ports>
Aug 14 12:07:54 user nova-compute[73012]:         <nova:port uuid="26881dfb-9732-4375-a667-098ca8538791">
Aug 14 12:07:54 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 12:07:54 user nova-compute[73012]:         </nova:port>
Aug 14 12:07:54 user nova-compute[73012]:       </nova:ports>
Aug 14 12:07:54 user nova-compute[73012]:     </nova:instance>
Aug 14 12:07:54 user nova-compute[73012]:   </metadata>
Aug 14 12:07:54 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:07:54 user nova-compute[73012]:     <system>
Aug 14 12:07:54 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:07:54 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:07:54 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:07:54 user nova-compute[73012]:       <entry name="serial">155f4cf4-3bfd-4529-bb26-529a500e61eb</entry>
Aug 14 12:07:54 user nova-compute[73012]:       <entry name="uuid">155f4cf4-3bfd-4529-bb26-529a500e61eb</entry>
Aug 14 12:07:54 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:07:54 user nova-compute[73012]:     </system>
Aug 14 12:07:54 user nova-compute[73012]:   </sysinfo>
Aug 14 12:07:54 user nova-compute[73012]:   <os>
Aug 14 12:07:54 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:07:54 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:07:54 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:07:54 user nova-compute[73012]:   </os>
Aug 14 12:07:54 user nova-compute[73012]:   <features>
Aug 14 12:07:54 user nova-compute[73012]:     <acpi/>
Aug 14 12:07:54 user nova-compute[73012]:     <apic/>
Aug 14 12:07:54 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:07:54 user nova-compute[73012]:   </features>
Aug 14 12:07:54 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:07:54 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:07:54 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:07:54 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:07:54 user nova-compute[73012]:   </clock>
Aug 14 12:07:54 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:07:54 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:07:54 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:07:54 user nova-compute[73012]:   </cpu>
Aug 14 12:07:54 user nova-compute[73012]:   <devices>
Aug 14 12:07:54 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:07:54 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:07:54 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk"/>
Aug 14 12:07:54 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:07:54 user nova-compute[73012]:     </disk>
Aug 14 12:07:54 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:07:54 user nova-compute[73012]:       <mac address="fa:16:3e:cc:e1:26"/>
Aug 14 12:07:54 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:07:54 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:07:54 user nova-compute[73012]:       <target dev="tap26881dfb-97"/>
Aug 14 12:07:54 user nova-compute[73012]:     </interface>
Aug 14 12:07:54 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:07:54 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/console.log" append="off"/>
Aug 14 12:07:54 user nova-compute[73012]:     </serial>
Aug 14 12:07:54 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:07:54 user nova-compute[73012]:     <video>
Aug 14 12:07:54 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:07:54 user nova-compute[73012]:     </video>
Aug 14 12:07:54 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:07:54 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:07:54 user nova-compute[73012]:     </rng>
Aug 14 12:07:54 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:07:54 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:07:54 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:07:54 user nova-compute[73012]:     </memballoon>
Aug 14 12:07:54 user nova-compute[73012]:   </devices>
Aug 14 12:07:54 user nova-compute[73012]: </domain>
Aug 14 12:07:54 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-125341889',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-125341889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1253418',id=10,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+9Udl1ar2EtSlZ55/X2JbVR8IG+gv303XaT36DX1mMay+ahtNoBoibmnnYPvNoz7TabC0d8aP03/ndlyBYdUHgDty31rPT5Lk9liKtvN9OO/9dKzHipifKuhGOsU+/Bg==',key_name='tempest-keypair-1621558607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54fb585a888b4a7499315cd87da2c315',ramdisk_id='',reservation_id='r-mg2y5t0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1660840996',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5835e834cb846f795b3f13fa68bbec0',uuid=155f4cf4-3bfd-4529-bb26-529a500e61eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Converting VIF {"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e1:26,bridge_name='br-int',has_traffic_filtering=True,id=26881dfb-9732-4375-a667-098ca8538791,network=Network(c587c329-76aa-485a-837b-f751cd67bdb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26881dfb-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG os_vif [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e1:26,bridge_name='br-int',has_traffic_filtering=True,id=26881dfb-9732-4375-a667-098ca8538791,network=Network(c587c329-76aa-485a-837b-f751cd67bdb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26881dfb-97') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26881dfb-97, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26881dfb-97, col_values=(('external_ids', {'iface-id': '26881dfb-9732-4375-a667-098ca8538791', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:e1:26', 'vm-uuid': '155f4cf4-3bfd-4529-bb26-529a500e61eb'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6857c2d2-ecc3-493f-878c-e5c5a526e851]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:55 user nova-compute[73012]: INFO os_vif [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e1:26,bridge_name='br-int',has_traffic_filtering=True,id=26881dfb-9732-4375-a667-098ca8538791,network=Network(c587c329-76aa-485a-837b-f751cd67bdb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26881dfb-97')
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0682fc9-747c-4886-b91a-0d9b79d507e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)
Aug 14 12:07:55 user nova-compute[73012]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 (non-flash)
Aug 14 12:07:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)
Aug 14 12:07:55 user nova-compute[73012]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 (non-flash)
Aug 14 12:07:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[244ec027-e75e-45b7-8d66-185aac222b7d]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akFrtoun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] No VIF found with MAC fa:16:3e:cc:e1:26, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-8e0313c1-e2d9-4f8a-b584-89b5f4b39477 req-f610cdc9-0a08-4c59-ad66-811fdf3a525e service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received event network-changed-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-8e0313c1-e2d9-4f8a-b584-89b5f4b39477 req-f610cdc9-0a08-4c59-ad66-811fdf3a525e service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Refreshing instance network info cache due to event network-changed-fce00ee4-2792-4ba8-b784-985ba783b386. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8e0313c1-e2d9-4f8a-b584-89b5f4b39477 req-f610cdc9-0a08-4c59-ad66-811fdf3a525e service nova] Acquiring lock "refresh_cache-ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8e0313c1-e2d9-4f8a-b584-89b5f4b39477 req-f610cdc9-0a08-4c59-ad66-811fdf3a525e service nova] Acquired lock "refresh_cache-ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-8e0313c1-e2d9-4f8a-b584-89b5f4b39477 req-f610cdc9-0a08-4c59-ad66-811fdf3a525e service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Refreshing network info cache for port fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-54607ff9-02d6-4c98-ba0f-9642865f879f req-08af9215-7fc5-44a0-944f-1be9580eb373 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Updated VIF entry in instance network info cache for port 26881dfb-9732-4375-a667-098ca8538791. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-54607ff9-02d6-4c98-ba0f-9642865f879f req-08af9215-7fc5-44a0-944f-1be9580eb373 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Updating instance_info_cache with network_info: [{"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54607ff9-02d6-4c98-ba0f-9642865f879f req-08af9215-7fc5-44a0-944f-1be9580eb373 service nova] Releasing lock "refresh_cache-155f4cf4-3bfd-4529-bb26-529a500e61eb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.objects.instance [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lazy-loading 'flavor' on Instance uuid ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23366393635663736', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366393635663736', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lazy-loading 'flavor' on Instance uuid 273c3cd7-3897-4079-821b-b477102fd7ba {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:07:56 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:07:56 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:07:56 user nova-compute[73012]:   <target dev="sdc" bus="scsi"/>
Aug 14 12:07:56 user nova-compute[73012]:   <serial>6960cfc0-fe79-43b5-aa6e-871adcd0fc48</serial>
Aug 14 12:07:56 user nova-compute[73012]:   <address type="drive" controller="0" unit="2"/>
Aug 14 12:07:56 user nova-compute[73012]: </disk>
Aug 14 12:07:56 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:56 user nova-compute[73012]: INFO nova.compute.manager [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Attaching volume d7306760-6967-4276-9e27-89ea1b0dabe1 to /dev/vdb
Aug 14 12:07:56 user nova-compute[73012]: DEBUG os_brick.utils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.network.neutron [req-8e0313c1-e2d9-4f8a-b584-89b5f4b39477 req-f610cdc9-0a08-4c59-ad66-811fdf3a525e service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Updated VIF entry in instance network info cache for port fce00ee4-2792-4ba8-b784-985ba783b386. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.network.neutron [req-8e0313c1-e2d9-4f8a-b584-89b5f4b39477 req-f610cdc9-0a08-4c59-ad66-811fdf3a525e service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Updating instance_info_cache with network_info: [{"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb735c-427b-402a-b0d6-ff14ac30b619]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8e0313c1-e2d9-4f8a-b584-89b5f4b39477 req-f610cdc9-0a08-4c59-ad66-811fdf3a525e service nova] Releasing lock "refresh_cache-ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27249c5-0b8c-4cf2-ae64-73c109c15d80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b98898-7928-4a15-82b6-dd56a6ed44c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ee4af0-16d4-4bce-bc7f-a9e4f6e27e13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:07:56 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26acc04-adab-475f-93b5-b8ee3ace107b]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG os_brick.utils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Updating existing volume attachment record: 2b39ce50-fc2c-4136-a0a8-5b0ecc52e4cf {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:56 user nova-compute[73012]: INFO nova.compute.manager [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Detaching volume 058ade2f-1121-4b94-b14b-57f74f70d4b9
Aug 14 12:07:56 user nova-compute[73012]: INFO nova.virt.block_device [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Attempting to driver detach volume 058ade2f-1121-4b94-b14b-57f74f70d4b9 from mountpoint /dev/vdb
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Attempting to detach device vdb from instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:07:56 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:07:56 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:07:56 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:07:56 user nova-compute[73012]:   <serial>058ade2f-1121-4b94-b14b-57f74f70d4b9</serial>
Aug 14 12:07:56 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:07:56 user nova-compute[73012]: </disk>
Aug 14 12:07:56 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:07:56 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Successfully detached device vdb from instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 from the persistent domain config.
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:07:56 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:07:56 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:07:56 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:07:56 user nova-compute[73012]:   <serial>058ade2f-1121-4b94-b14b-57f74f70d4b9</serial>
Aug 14 12:07:56 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:07:56 user nova-compute[73012]: </disk>
Aug 14 12:07:56 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] No BDM found with device name sda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:07:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] No VIF found with MAC fa:16:3e:32:f5:24, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c1d86c76-d786-4e81-8eb1-f069f1d7b51c tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.286s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692014877.4799595, 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:07:57 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Successfully detached device vdb from instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 from the live domain config.
Aug 14 12:07:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AscrEGMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:07:57 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb128275-3d10-40a0-aff8-ade4ab72b72b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4876d382-c871-43aa-ae50-0bf0d99fbfd8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)
Aug 14 12:07:57 user nova-compute[73012]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 (non-flash)
Aug 14 12:07:57 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 (non-flash)
Aug 14 12:07:57 user nova-compute[73012]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 (non-flash)
Aug 14 12:07:57 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad06b6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad74f32-867e-43a5-8436-4d6b1d12e0da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d1fb0d-cbc4-4eb7-b373-5e2a4f87649e]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd6f7bc-4245-4685-8f64-1481e698b4d8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[367645cb-981e-4e34-ac90-9db1a95b4c93]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e799db4-ff62-4bac-a300-ccc95b249477]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[39076404-d888-4886-9fa9-0be2048cf82e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9, portal: 172.16.0.220,3260]
Aug 14 12:07:57 user nova-compute[73012]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9, portal: 172.16.0.220,3260] successful.
Aug 14 12:07:57 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received event network-vif-plugged-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] No waiting events found dispatching network-vif-plugged-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:07:57 user nova-compute[73012]: WARNING nova.compute.manager [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received unexpected event network-vif-plugged-26881dfb-9732-4375-a667-098ca8538791 for instance with vm_state building and task_state spawning.
Aug 14 12:07:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received event network-vif-plugged-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] No waiting events found dispatching network-vif-plugged-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:07:57 user nova-compute[73012]: WARNING nova.compute.manager [req-cace8534-234e-4ac9-894b-84b2b1cfc2e5 req-e6a63a83-bbb1-479f-95cf-bf2e53a21368 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received unexpected event network-vif-plugged-26881dfb-9732-4375-a667-098ca8538791 for instance with vm_state building and task_state spawning.
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058ade2f-1121-4b94-b14b-57f74f70d4b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea477941-5bf8-4b0b-a440-a7084884f8a0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] <== disconnect_volume: return (362ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:07:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:07:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "interface-96b9a98d-d416-40ef-aa85-ce23ad77e9d7-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "interface-96b9a98d-d416-40ef-aa85-ce23ad77e9d7-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:58 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lazy-loading 'flavor' on Instance uuid 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:58 user nova-compute[73012]: DEBUG nova.objects.instance [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lazy-loading 'flavor' on Instance uuid 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-68d5c30f-4c5d-47cd-854f-504efdc2174b tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.199s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:58 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lazy-loading 'pci_requests' on Instance uuid 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:07:58 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.policy [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bd40979075344b28d0223d4b5084508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60f4140fa9e464ba556f644132aad96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Successfully created port: 753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014879.5499823, 155f4cf4-3bfd-4529-bb26-529a500e61eb => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] VM Resumed (Lifecycle Event)
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Instance spawned successfully.
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014879.5511568, 155f4cf4-3bfd-4529-bb26-529a500e61eb => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] VM Started (Lifecycle Event)
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.compute.manager [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Detaching volume 6960cfc0-fe79-43b5-aa6e-871adcd0fc48
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Took 7.83 seconds to spawn the instance on the hypervisor.
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.virt.block_device [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Attempting to driver detach volume 6960cfc0-fe79-43b5-aa6e-871adcd0fc48 from mountpoint /dev/sdc
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Attempting to detach device sdc from instance 273c3cd7-3897-4079-821b-b477102fd7ba from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:07:59 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:07:59 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:07:59 user nova-compute[73012]:   <target dev="sdc" bus="scsi"/>
Aug 14 12:07:59 user nova-compute[73012]:   <serial>6960cfc0-fe79-43b5-aa6e-871adcd0fc48</serial>
Aug 14 12:07:59 user nova-compute[73012]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 12:07:59 user nova-compute[73012]: </disk>
Aug 14 12:07:59 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Successfully detached device sdc from instance 273c3cd7-3897-4079-821b-b477102fd7ba from the persistent domain config.
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 273c3cd7-3897-4079-821b-b477102fd7ba from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:07:59 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:07:59 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:07:59 user nova-compute[73012]:   <target dev="sdc" bus="scsi"/>
Aug 14 12:07:59 user nova-compute[73012]:   <serial>6960cfc0-fe79-43b5-aa6e-871adcd0fc48</serial>
Aug 14 12:07:59 user nova-compute[73012]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 12:07:59 user nova-compute[73012]: </disk>
Aug 14 12:07:59 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:07:59 user nova-compute[73012]: INFO nova.compute.manager [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Took 8.63 seconds to build instance.
Aug 14 12:07:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-28f0948c-4138-4435-acba-80aab42bf491 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.801s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-692e9290-af43-4f05-9bb3-e5e78308da51 req-df9cb62c-4d0d-4854-bb0f-01147151555d service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-changed-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-692e9290-af43-4f05-9bb3-e5e78308da51 req-df9cb62c-4d0d-4854-bb0f-01147151555d service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Refreshing instance network info cache due to event network-changed-30ec13f3-55af-4216-a06e-63bc7b1fb9b6. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-692e9290-af43-4f05-9bb3-e5e78308da51 req-df9cb62c-4d0d-4854-bb0f-01147151555d service nova] Acquiring lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-692e9290-af43-4f05-9bb3-e5e78308da51 req-df9cb62c-4d0d-4854-bb0f-01147151555d service nova] Acquired lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-692e9290-af43-4f05-9bb3-e5e78308da51 req-df9cb62c-4d0d-4854-bb0f-01147151555d service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Refreshing network info cache for port 30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:07:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692014880.1690667, 273c3cd7-3897-4079-821b-b477102fd7ba => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 273c3cd7-3897-4079-821b-b477102fd7ba {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:08:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Successfully detached device sdc from instance 273c3cd7-3897-4079-821b-b477102fd7ba from the live domain config.
Aug 14 12:08:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akFrtoun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:00 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8509a5a-9610-4141-8470-4296bca0a69b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a649508-0990-42fb-8f70-ee7c5267beb5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 (non-flash)
Aug 14 12:08:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 (non-flash)
Aug 14 12:08:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad05c6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[511d34af-5453-484d-8806-114feb184cac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4f55f8-64b2-4dbe-ad33-c7b6cea94bf3]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2268a024-effc-4172-b8ae-f3e9d90e6df9]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1c988d-fae2-49bf-be48-1d59903916cc]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Successfully updated port: 753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9542395f-c058-45e0-bd81-be085e8ab723]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5445344b-65c6-48c7-8a03-06a67404df1d]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48, portal: 172.16.0.220,3260]
Aug 14 12:08:00 user nova-compute[73012]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6960cfc0-fe79-43b5-aa6e-871adcd0fc48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9574f9-d990-4089-8aed-d14ea9cbeed6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] <== disconnect_volume: return (305ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG nova.network.neutron [req-692e9290-af43-4f05-9bb3-e5e78308da51 req-df9cb62c-4d0d-4854-bb0f-01147151555d service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updated VIF entry in instance network info cache for port 30ec13f3-55af-4216-a06e-63bc7b1fb9b6. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG nova.network.neutron [req-692e9290-af43-4f05-9bb3-e5e78308da51 req-df9cb62c-4d0d-4854-bb0f-01147151555d service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updating instance_info_cache with network_info: [{"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-692e9290-af43-4f05-9bb3-e5e78308da51 req-df9cb62c-4d0d-4854-bb0f-01147151555d service nova] Releasing lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquired lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lazy-loading 'flavor' on Instance uuid 273c3cd7-3897-4079-821b-b477102fd7ba {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updating instance_info_cache with network_info: [{"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Releasing lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517741125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517741125',id=8,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2TTpmfaQPgY9ohNbVadAHJOLiNi1lPNazCQ0/vgYaopsQex8HgTVtrzr1PsGl+iZ8XzkXNAGaX1YvJAn1t8iAMrG6pCLvmKBNfbkLxAoKRO+zDopEQxka9+HZl/6dPMQ==',key_name='tempest-keypair-779145758',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a60f4140fa9e464ba556f644132aad96',ramdisk_id='',reservation_id='r-7nj3lvpu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1305129888',owner_user_name='tempest-TaggedAttachmentsTest-1305129888-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd40979075344b28d0223d4b5084508',uuid=96b9a98d-d416-40ef-aa85-ce23ad77e9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converting VIF {"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ec:97,bridge_name='br-int',has_traffic_filtering=True,id=753db93c-97d2-463a-a3f4-052380c2c964,network=Network(09268389-e9b5-48c3-bd77-7d486a0f9ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap753db93c-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG os_vif [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ec:97,bridge_name='br-int',has_traffic_filtering=True,id=753db93c-97d2-463a-a3f4-052380c2c964,network=Network(09268389-e9b5-48c3-bd77-7d486a0f9ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap753db93c-97') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap753db93c-97, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap753db93c-97, col_values=(('external_ids', {'iface-id': '753db93c-97d2-463a-a3f4-052380c2c964', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:ec:97', 'vm-uuid': '96b9a98d-d416-40ef-aa85-ce23ad77e9d7'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d944a482-204b-4658-86e4-133564209b95 tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.891s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:01 user nova-compute[73012]: INFO os_vif [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ec:97,bridge_name='br-int',has_traffic_filtering=True,id=753db93c-97d2-463a-a3f4-052380c2c964,network=Network(09268389-e9b5-48c3-bd77-7d486a0f9ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap753db93c-97')
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517741125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517741125',id=8,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2TTpmfaQPgY9ohNbVadAHJOLiNi1lPNazCQ0/vgYaopsQex8HgTVtrzr1PsGl+iZ8XzkXNAGaX1YvJAn1t8iAMrG6pCLvmKBNfbkLxAoKRO+zDopEQxka9+HZl/6dPMQ==',key_name='tempest-keypair-779145758',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a60f4140fa9e464ba556f644132aad96',ramdisk_id='',reservation_id='r-7nj3lvpu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1305129888',owner_user_name='tempest-TaggedAttachmentsTest-1305129888-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd40979075344b28d0223d4b5084508',uuid=96b9a98d-d416-40ef-aa85-ce23ad77e9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converting VIF {"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ec:97,bridge_name='br-int',has_traffic_filtering=True,id=753db93c-97d2-463a-a3f4-052380c2c964,network=Network(09268389-e9b5-48c3-bd77-7d486a0f9ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap753db93c-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] attach device xml: <interface type="ethernet">
Aug 14 12:08:01 user nova-compute[73012]:   <mac address="fa:16:3e:5d:ec:97"/>
Aug 14 12:08:01 user nova-compute[73012]:   <model type="virtio"/>
Aug 14 12:08:01 user nova-compute[73012]:   <mtu size="1442"/>
Aug 14 12:08:01 user nova-compute[73012]:   <target dev="tap753db93c-97"/>
Aug 14 12:08:01 user nova-compute[73012]: </interface>
Aug 14 12:08:01 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-95453531-c003-4c41-a71e-e05f7fd3caac req-fbdc1a50-f5eb-4355-9046-3e7859353113 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-changed-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-95453531-c003-4c41-a71e-e05f7fd3caac req-fbdc1a50-f5eb-4355-9046-3e7859353113 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Refreshing instance network info cache due to event network-changed-753db93c-97d2-463a-a3f4-052380c2c964. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-95453531-c003-4c41-a71e-e05f7fd3caac req-fbdc1a50-f5eb-4355-9046-3e7859353113 service nova] Acquiring lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-95453531-c003-4c41-a71e-e05f7fd3caac req-fbdc1a50-f5eb-4355-9046-3e7859353113 service nova] Acquired lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-95453531-c003-4c41-a71e-e05f7fd3caac req-fbdc1a50-f5eb-4355-9046-3e7859353113 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Refreshing network info cache for port 753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] No BDM found with device name hda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] No VIF found with MAC fa:16:3e:a2:ae:c8, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:08:02 user nova-compute[73012]:   <nova:package version="0.0.0"/>
Aug 14 12:08:02 user nova-compute[73012]:   <nova:name>tempest-device-tagging-server-517741125</nova:name>
Aug 14 12:08:02 user nova-compute[73012]:   <nova:creationTime>2023-08-14 12:08:02</nova:creationTime>
Aug 14 12:08:02 user nova-compute[73012]:   <nova:flavor name="m1.tiny">
Aug 14 12:08:02 user nova-compute[73012]:     <nova:memory>512</nova:memory>
Aug 14 12:08:02 user nova-compute[73012]:     <nova:disk>1</nova:disk>
Aug 14 12:08:02 user nova-compute[73012]:     <nova:swap>0</nova:swap>
Aug 14 12:08:02 user nova-compute[73012]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:08:02 user nova-compute[73012]:     <nova:vcpus>1</nova:vcpus>
Aug 14 12:08:02 user nova-compute[73012]:   </nova:flavor>
Aug 14 12:08:02 user nova-compute[73012]:   <nova:owner>
Aug 14 12:08:02 user nova-compute[73012]:     <nova:user uuid="7bd40979075344b28d0223d4b5084508">tempest-TaggedAttachmentsTest-1305129888-project-member</nova:user>
Aug 14 12:08:02 user nova-compute[73012]:     <nova:project uuid="a60f4140fa9e464ba556f644132aad96">tempest-TaggedAttachmentsTest-1305129888</nova:project>
Aug 14 12:08:02 user nova-compute[73012]:   </nova:owner>
Aug 14 12:08:02 user nova-compute[73012]:   <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:08:02 user nova-compute[73012]:   <nova:ports>
Aug 14 12:08:02 user nova-compute[73012]:     <nova:port uuid="30ec13f3-55af-4216-a06e-63bc7b1fb9b6">
Aug 14 12:08:02 user nova-compute[73012]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:08:02 user nova-compute[73012]:     </nova:port>
Aug 14 12:08:02 user nova-compute[73012]:     <nova:port uuid="753db93c-97d2-463a-a3f4-052380c2c964">
Aug 14 12:08:02 user nova-compute[73012]:       <nova:ip type="fixed" address="10.10.10.54" ipVersion="4"/>
Aug 14 12:08:02 user nova-compute[73012]:     </nova:port>
Aug 14 12:08:02 user nova-compute[73012]:   </nova:ports>
Aug 14 12:08:02 user nova-compute[73012]: </nova:instance>
Aug 14 12:08:02 user nova-compute[73012]:  {{(pid=73012) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:02 user nova-compute[73012]: INFO nova.compute.manager [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Terminating instance
Aug 14 12:08:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7cd4a739-28e8-4cbb-bb1c-ddb2983ef01e tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "interface-96b9a98d-d416-40ef-aa85-ce23ad77e9d7-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.531s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lazy-loading 'flavor' on Instance uuid 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-95453531-c003-4c41-a71e-e05f7fd3caac req-fbdc1a50-f5eb-4355-9046-3e7859353113 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updated VIF entry in instance network info cache for port 753db93c-97d2-463a-a3f4-052380c2c964. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-95453531-c003-4c41-a71e-e05f7fd3caac req-fbdc1a50-f5eb-4355-9046-3e7859353113 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updating instance_info_cache with network_info: [{"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-95453531-c003-4c41-a71e-e05f7fd3caac req-fbdc1a50-f5eb-4355-9046-3e7859353113 service nova] Releasing lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Instance destroyed successfully.
Aug 14 12:08:03 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lazy-loading 'resources' on Instance uuid 273c3cd7-3897-4079-821b-b477102fd7ba {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:03 user nova-compute[73012]: INFO nova.compute.manager [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Attaching volume 8f8f37c1-1884-46b2-89cd-d938dc8039df to /dev/vdb
Aug 14 12:08:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1888994744',display_name='tempest-AttachSCSIVolumeTestJSON-server-1888994744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1888994744',id=5,image_ref='7938dfef-d3eb-4eb4-8adb-886a305d18cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYuwSUd6ePV2OpwF6INaaJoQucobQiD9Q+hobYo8KAZgKtfQMxhwt4I5BZ1fN9tQKqmUFDw0DHoHxPaJiCq6gMOOi5tdGtdh/ZPQAqF6JY8V00bZqHhfOx4m0tmkl8uqw==',key_name='tempest-keypair-32983871',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:05:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54d96d1067094c98aa1ae74f4be7f1ff',ramdisk_id='',reservation_id='r-2la2l0cc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7938dfef-d3eb-4eb4-8adb-886a305d18cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-486432696',owner_user_name='tempest-AttachSCSIVolumeTestJSON-486432696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='266f3348f9fe431a8afb6187a2e1cb9e',uuid=273c3cd7-3897-4079-821b-b477102fd7ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Converting VIF {"id": "6ce711be-e9df-4d5b-9df7-4a039750507d", "address": "fa:16:3e:32:f5:24", "network": {"id": "11dbde77-2375-4998-b49c-6f4000a9c1e5", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2054143794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54d96d1067094c98aa1ae74f4be7f1ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce711be-e9", "ovs_interfaceid": "6ce711be-e9df-4d5b-9df7-4a039750507d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:f5:24,bridge_name='br-int',has_traffic_filtering=True,id=6ce711be-e9df-4d5b-9df7-4a039750507d,network=Network(11dbde77-2375-4998-b49c-6f4000a9c1e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce711be-e9') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG os_vif [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:f5:24,bridge_name='br-int',has_traffic_filtering=True,id=6ce711be-e9df-4d5b-9df7-4a039750507d,network=Network(11dbde77-2375-4998-b49c-6f4000a9c1e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce711be-e9') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ce711be-e9, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:08:03 user nova-compute[73012]: INFO os_vif [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:f5:24,bridge_name='br-int',has_traffic_filtering=True,id=6ce711be-e9df-4d5b-9df7-4a039750507d,network=Network(11dbde77-2375-4998-b49c-6f4000a9c1e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce711be-e9')
Aug 14 12:08:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Deleting instance files /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba_del
Aug 14 12:08:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Deletion of /opt/stack/data/nova/instances/273c3cd7-3897-4079-821b-b477102fd7ba_del complete
Aug 14 12:08:03 user nova-compute[73012]: DEBUG os_brick.utils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[72949775-e35c-4cb3-a2c9-428931846cee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb13a1b-182d-4f85-9e11-cb8fdfcd1e7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:03 user nova-compute[73012]: INFO nova.compute.manager [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bf22fc-b8ce-4b0a-a94b-d16b3b7bd19d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7ff055-acd7-4437-8d7a-dbe892736b8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:08:03 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:08:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b4a6e-1efb-4808-86c3-8a4390f82c23]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG os_brick.utils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:03 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updating existing volume attachment record: 68ccc7b6-880b-40b0-80bb-e09ce31aa4b4 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received event network-vif-unplugged-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] No waiting events found dispatching network-vif-unplugged-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received event network-vif-unplugged-6ce711be-e9df-4d5b-9df7-4a039750507d for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received event network-vif-plugged-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] Acquiring lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] Lock "273c3cd7-3897-4079-821b-b477102fd7ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] No waiting events found dispatching network-vif-plugged-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:04 user nova-compute[73012]: WARNING nova.compute.manager [req-71ce0430-ee19-444b-af7e-cb2675a2706e req-9b0077d8-8e38-494e-ac44-cfe250fb082c service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received unexpected event network-vif-plugged-6ce711be-e9df-4d5b-9df7-4a039750507d for instance with vm_state active and task_state deleting.
Aug 14 12:08:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-690b6113-3e42-4776-a67c-fdfdfab241a0 req-2e9ff68e-3cfa-4a2e-90dd-5b0c617c1ea0 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-plugged-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-690b6113-3e42-4776-a67c-fdfdfab241a0 req-2e9ff68e-3cfa-4a2e-90dd-5b0c617c1ea0 service nova] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-690b6113-3e42-4776-a67c-fdfdfab241a0 req-2e9ff68e-3cfa-4a2e-90dd-5b0c617c1ea0 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-690b6113-3e42-4776-a67c-fdfdfab241a0 req-2e9ff68e-3cfa-4a2e-90dd-5b0c617c1ea0 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-690b6113-3e42-4776-a67c-fdfdfab241a0 req-2e9ff68e-3cfa-4a2e-90dd-5b0c617c1ea0 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] No waiting events found dispatching network-vif-plugged-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:04 user nova-compute[73012]: WARNING nova.compute.manager [req-690b6113-3e42-4776-a67c-fdfdfab241a0 req-2e9ff68e-3cfa-4a2e-90dd-5b0c617c1ea0 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received unexpected event network-vif-plugged-753db93c-97d2-463a-a3f4-052380c2c964 for instance with vm_state active and task_state None.
Aug 14 12:08:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDfIuViF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:04 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:04 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:04 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70c8115-41e3-4505-a509-00d8a4adc160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:08:04 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27f2ccc-afa9-42a3-9fec-b962cd4b87c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef] added
Aug 14 12:08:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad9f534-067c-4ab5-91f9-67f4a151712f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39aac0e-f68b-432c-ab40-b49be5716a2a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDfIuViF {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDfIuViF" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4688a1bb-76c4-4a89-912b-097eeedaba09]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xDfIuViF'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1fdbd8-4808-415f-a870-d003754f23f6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d3fc34-5586-4846-9f82-571aae5a021d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:08:04 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:08:04 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:04 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:08:04 user nova-compute[73012]: 
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[267c1003-8833-4e86-bc20-ff8d1a303947]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef, portal: 172.16.0.220,3260]
Aug 14 12:08:04 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7860f01f-c6e4-4ae7-a288-cde64c9e71c8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[008696e7-0302-43cb-b34a-4e9d5edab658]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)
Aug 14 12:08:05 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)
Aug 14 12:08:05 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b56778-77d5-454e-979d-af7d395485e5]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDfIuViF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:05 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Took 2.66 seconds to deallocate network for instance.
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26539323031613035', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539323031613035', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lazy-loading 'flavor' on Instance uuid e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] attach device xml: <disk type="block" device="disk">
Aug 14 12:08:06 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:06 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:08:06 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:08:06 user nova-compute[73012]:   <serial>934acbf6-2cf1-47f3-8f62-86e54a8b8eef</serial>
Aug 14 12:08:06 user nova-compute[73012]: </disk>
Aug 14 12:08:06 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:06 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Deleted allocations for instance 273c3cd7-3897-4079-821b-b477102fd7ba
Aug 14 12:08:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d4f90054-f5a7-4fb8-88a7-75dfecf56d9d tempest-AttachSCSIVolumeTestJSON-486432696 tempest-AttachSCSIVolumeTestJSON-486432696-project-member] Lock "273c3cd7-3897-4079-821b-b477102fd7ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.365s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-17a769a4-2d68-4482-8120-fdafa362575f req-7d363dd8-d1db-4d17-bed1-c8e2f4ca6113 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-plugged-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-17a769a4-2d68-4482-8120-fdafa362575f req-7d363dd8-d1db-4d17-bed1-c8e2f4ca6113 service nova] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-17a769a4-2d68-4482-8120-fdafa362575f req-7d363dd8-d1db-4d17-bed1-c8e2f4ca6113 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-17a769a4-2d68-4482-8120-fdafa362575f req-7d363dd8-d1db-4d17-bed1-c8e2f4ca6113 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-17a769a4-2d68-4482-8120-fdafa362575f req-7d363dd8-d1db-4d17-bed1-c8e2f4ca6113 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] No waiting events found dispatching network-vif-plugged-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:06 user nova-compute[73012]: WARNING nova.compute.manager [req-17a769a4-2d68-4482-8120-fdafa362575f req-7d363dd8-d1db-4d17-bed1-c8e2f4ca6113 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received unexpected event network-vif-plugged-753db93c-97d2-463a-a3f4-052380c2c964 for instance with vm_state active and task_state None.
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-17a769a4-2d68-4482-8120-fdafa362575f req-7d363dd8-d1db-4d17-bed1-c8e2f4ca6113 service nova] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Received event network-vif-deleted-6ce711be-e9df-4d5b-9df7-4a039750507d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] No VIF found with MAC fa:16:3e:1b:4d:05, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d97349-b9ac-4519-afb1-83f65a9582f4 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.800s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGDpsTBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:07 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:07 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:07 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c61e35-a9c5-4f97-8a83-128e06cdc790]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:08:07 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9f0580-ce68-479c-b15f-1cdde100a011]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1] added
Aug 14 12:08:07 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25b89e3-8999-4d8d-9cb3-dabec658b817]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[93671d26-c5d8-43c2-ab44-ae276bd44b69]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGDpsTBz {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGDpsTBz" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95bb3a7-f4ab-48f6-89b7-451ddeaed55d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LGDpsTBz'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3135837b-06b7-46c2-9df9-f80821b04c17]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d79180-bd8c-4832-9a60-cd87ac507058]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)
Aug 14 12:08:07 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)
Aug 14 12:08:07 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99fe882-1a26-4b49-a3d3-9cedaa918651]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260]
Aug 14 12:08:07 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:07 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[970a7cc0-4710-4a3d-924e-9118911c9be8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[280fd630-6f09-4ea5-8863-b4ec7002e499]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)
Aug 14 12:08:07 user nova-compute[73012]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:07 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)
Aug 14 12:08:07 user nova-compute[73012]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:07 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5967ddd-ed76-474e-bfcc-5c9ca2a43d45]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:07 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e8db10c4-18be-459e-ac14-e647878c026e tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] volume_snapshot_create: create_info: {'snapshot_id': '8b4df944-f8d2-4320-bdb4-09b3a31d4a84', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73012) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e8db10c4-18be-459e-ac14-e647878c026e tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] snap xml: <domainsnapshot>
Aug 14 12:08:08 user nova-compute[73012]:   <disks>
Aug 14 12:08:08 user nova-compute[73012]:     <disk name="/dev/sdb" snapshot="external" type="file">
Aug 14 12:08:08 user nova-compute[73012]:       <source file="/dev/new_file"/>
Aug 14 12:08:08 user nova-compute[73012]:     </disk>
Aug 14 12:08:08 user nova-compute[73012]:     <disk name="vda" snapshot="no"/>
Aug 14 12:08:08 user nova-compute[73012]:   </disks>
Aug 14 12:08:08 user nova-compute[73012]: </domainsnapshot>
Aug 14 12:08:08 user nova-compute[73012]:  {{(pid=73012) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e8db10c4-18be-459e-ac14-e647878c026e tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lazy-loading 'system_metadata' on Instance uuid e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e8db10c4-18be-459e-ac14-e647878c026e tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [None req-e8db10c4-18be-459e-ac14-e647878c026e tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     rv = execute(f, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     six.reraise(c, e, tb)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     raise value
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     rv = meth(*args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [None req-e8db10c4-18be-459e-ac14-e647878c026e tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     self._volume_snapshot_create(context, instance, guest,
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     rv = execute(f, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     six.reraise(c, e, tb)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     raise value
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     rv = meth(*args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] 
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-559d1e6f-1ce5-48ad-b0ee-22cd30606d9f tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] volume_snapshot_delete: delete_info: {'volume_id': '934acbf6-2cf1-47f3-8f62-86e54a8b8eef'} {{(pid=73012) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [None req-559d1e6f-1ce5-48ad-b0ee-22cd30606d9f tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7]     if delete_info['type'] != 'qcow2':
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] KeyError: 'type'
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [None req-559d1e6f-1ce5-48ad-b0ee-22cd30606d9f tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ad198caf-6377-4c0c-86cb-756335abfa1a)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver [None req-e8db10c4-18be-459e-ac14-e647878c026e tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8b4df944-f8d2-4320-bdb4-09b3a31d4a84 could not be found.
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     raise value
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8b4df944-f8d2-4320-bdb4-09b3a31d4a84 could not be found. (HTTP 404) (Request-ID: req-1972d5b8-5371-4c2e-94fb-9fa50f6a71b3)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8b4df944-f8d2-4320-bdb4-09b3a31d4a84 could not be found.
Aug 14 12:08:08 user nova-compute[73012]: ERROR nova.virt.libvirt.driver 
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server [None req-559d1e6f-1ce5-48ad-b0ee-22cd30606d9f tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Exception during message handling: KeyError: 'type'
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server 
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server [None req-e8db10c4-18be-459e-ac14-e647878c026e tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     raise value
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 12:08:08 user nova-compute[73012]: ERROR oslo_messaging.rpc.server 
Aug 14 12:08:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:08 user nova-compute[73012]: INFO nova.compute.manager [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Detaching volume 934acbf6-2cf1-47f3-8f62-86e54a8b8eef
Aug 14 12:08:08 user nova-compute[73012]: INFO nova.virt.block_device [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Attempting to driver detach volume 934acbf6-2cf1-47f3-8f62-86e54a8b8eef from mountpoint /dev/vdb
Aug 14 12:08:08 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGDpsTBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26266343831343138', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266343831343138', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Attempting to detach device vdb from instance e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 12:08:08 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:08 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:08:08 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:08:08 user nova-compute[73012]:   <serial>934acbf6-2cf1-47f3-8f62-86e54a8b8eef</serial>
Aug 14 12:08:08 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:08:08 user nova-compute[73012]: </disk>
Aug 14 12:08:08 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.objects.instance [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lazy-loading 'flavor' on Instance uuid ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Successfully detached device vdb from instance e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 from the persistent domain config.
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 12:08:08 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:08 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:08:08 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:08:08 user nova-compute[73012]:   <serial>934acbf6-2cf1-47f3-8f62-86e54a8b8eef</serial>
Aug 14 12:08:08 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:08:08 user nova-compute[73012]: </disk>
Aug 14 12:08:08 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:08:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:08:08 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:08 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:08:08 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:08:08 user nova-compute[73012]:   <serial>d7306760-6967-4276-9e27-89ea1b0dabe1</serial>
Aug 14 12:08:08 user nova-compute[73012]: </disk>
Aug 14 12:08:08 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] No VIF found with MAC fa:16:3e:74:34:8f, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-68dad5c6-7366-496c-a5d8-8b2dd6573b39 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.220s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692014889.5388098, e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:08:09 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Successfully detached device vdb from instance e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 from the live domain config.
Aug 14 12:08:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDfIuViF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:09 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[394323d5-d5b2-493c-977b-a857e78e8433]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[450d823b-d8a1-4cb4-b5fb-72644be63078]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)
Aug 14 12:08:09 user nova-compute[73012]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:09 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef (non-flash)
Aug 14 12:08:09 user nova-compute[73012]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:09 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9af7bee950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[336dca4d-1cc0-427a-8604-c3f2df92f442]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46254bb-ef49-4921-861d-1a1b7d8fd1ec]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[864a562d-d947-483e-b84c-674a5af80b9f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea21f82e-4ed4-4c92-92df-db8daede8762]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe9b41b-ed5d-45d5-bf0b-0afa4d302ede]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4741677-ecf1-4e2d-8186-0e5f1e531344]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef, portal: 172.16.0.220,3260]
Aug 14 12:08:09 user nova-compute[73012]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:09 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934acbf6-2cf1-47f3-8f62-86e54a8b8eef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[783aaaca-0c01-4322-8cb8-7f63cb4a0911]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] <== disconnect_volume: return (266ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG nova.objects.instance [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lazy-loading 'flavor' on Instance uuid e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5bb70d11-d477-46e8-80ea-4e2860178752 tempest-VolumesAssistedSnapshotsTest-546103595 tempest-VolumesAssistedSnapshotsTest-546103595-project-admin] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.910s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG os_brick.utils [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[44794a3f-589b-4021-8ffc-6ffe2a9f5068]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1674226-eec9-4482-a002-b94511c35333]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde82b60-01b7-4fdd-a3f9-a2915fee1561]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8979e1-10b0-4e9f-8ed5-2659a3045914]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:08:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:08:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:08:11 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:08:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6907540-ff4a-42d0-a6d2-8169c2d0c7cb]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:08:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:08:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:08:11 user nova-compute[73012]: DEBUG os_brick.utils [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:11 user nova-compute[73012]: INFO nova.compute.manager [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Swapping volume d7306760-6967-4276-9e27-89ea1b0dabe1 for 9fad420e-430a-4acf-9478-2815226f8cd1
Aug 14 12:08:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfeoKCJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:12 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:12 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:12 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5017406-5370-495f-8aaf-4a81bc23c6b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:08:12 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa1465-103a-443c-a03a-4af5bd1ed93a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df] added
Aug 14 12:08:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e266aa-f305-4997-8c4a-353e3c361986]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a833f2d-fb93-4dc6-afb6-730969af2e51]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfeoKCJj {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfeoKCJj" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eae171-28a6-4196-9db9-aab135fdfd90]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GfeoKCJj'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ff8c0b-0806-4a9a-99f1-5a42ef7e7383]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86f8998-746c-4184-ae68-411d113b0807]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e192912d-a098-40bf-b1fb-7d20faaa8a9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df, portal: 172.16.0.220,3260]
Aug 14 12:08:12 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f6a545-7236-4bd7-af52-b9dcbb3f3bb5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a387e0d7-d6fb-40ad-824c-11790d309152]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:12 user nova-compute[73012]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df (non-flash)
Aug 14 12:08:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:12 user nova-compute[73012]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df (non-flash)
Aug 14 12:08:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] HCTL ('33', '-', '-', 0) found on session 6 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[055ea979-b075-4c07-bb04-ab6296530dec]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Searching for a device in session 6 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:08:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfeoKCJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:08:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23162356263383631', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162356263383631', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:08:13 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lazy-loading 'flavor' on Instance uuid 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:08:13 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:13 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:08:13 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:08:13 user nova-compute[73012]:   <serial>8f8f37c1-1884-46b2-89cd-d938dc8039df</serial>
Aug 14 12:08:13 user nova-compute[73012]: </disk>
Aug 14 12:08:13 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:08:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] No BDM found with device name hda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] No VIF found with MAC fa:16:3e:a2:ae:c8, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:08:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d73deea1-2472-43d2-bba9-c57456470e06 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.437s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:15 user nova-compute[73012]: INFO nova.compute.manager [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Detaching volume 8f8f37c1-1884-46b2-89cd-d938dc8039df
Aug 14 12:08:15 user nova-compute[73012]: INFO nova.virt.block_device [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Attempting to driver detach volume 8f8f37c1-1884-46b2-89cd-d938dc8039df from mountpoint /dev/vdb
Aug 14 12:08:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Attempting to detach device vdb from instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:08:15 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:15 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:08:15 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:08:15 user nova-compute[73012]:   <serial>8f8f37c1-1884-46b2-89cd-d938dc8039df</serial>
Aug 14 12:08:15 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 12:08:15 user nova-compute[73012]: </disk>
Aug 14 12:08:15 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:08:15 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Successfully detached device vdb from instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 from the persistent domain config.
Aug 14 12:08:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:08:15 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:15 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:08:15 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:08:15 user nova-compute[73012]:   <serial>8f8f37c1-1884-46b2-89cd-d938dc8039df</serial>
Aug 14 12:08:15 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 12:08:15 user nova-compute[73012]: </disk>
Aug 14 12:08:15 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692014895.9849517, 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:08:15 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Successfully detached device vdb from instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 from the live domain config.
Aug 14 12:08:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfeoKCJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:15 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:08:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdbcd75-3c90-40e9-85ef-63b0e9cb600f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d2b0dc-ba6f-4551-9dc9-a9b708be51aa]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:16 user nova-compute[73012]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df (non-flash)
Aug 14 12:08:16 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:16 user nova-compute[73012]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df (non-flash)
Aug 14 12:08:16 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad05c4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[93df5e1c-a92b-4b03-8a01-5afe9ab16de3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513f3b3-85fe-448c-b094-b97340402615]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fa9bd1-cfef-4bcb-8d01-ad908a68847b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aec2f7-fc43-4226-b640-42f3780f0718]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5762b8-fbba-4e2b-a305-0e6c4e40c0b3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fc4028-d4ce-4bb5-a8ee-dffa99db36ad]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df, portal: 172.16.0.220,3260]
Aug 14 12:08:16 user nova-compute[73012]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:16 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f8f37c1-1884-46b2-89cd-d938dc8039df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4368a4-c0ea-4c82-b736-5cd096b93ea2]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] <== disconnect_volume: return (251ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lazy-loading 'flavor' on Instance uuid 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c98acbf9-e4f1-4cc5-9d27-3f2937120286 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "interface-96b9a98d-d416-40ef-aa85-ce23ad77e9d7-753db93c-97d2-463a-a3f4-052380c2c964" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "interface-96b9a98d-d416-40ef-aa85-ce23ad77e9d7-753db93c-97d2-463a-a3f4-052380c2c964" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.objects.instance [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lazy-loading 'flavor' on Instance uuid 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517741125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517741125',id=8,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2TTpmfaQPgY9ohNbVadAHJOLiNi1lPNazCQ0/vgYaopsQex8HgTVtrzr1PsGl+iZ8XzkXNAGaX1YvJAn1t8iAMrG6pCLvmKBNfbkLxAoKRO+zDopEQxka9+HZl/6dPMQ==',key_name='tempest-keypair-779145758',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a60f4140fa9e464ba556f644132aad96',ramdisk_id='',reservation_id='r-7nj3lvpu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1305129888',owner_user_name='tempest-TaggedAttachmentsTest-1305129888-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd40979075344b28d0223d4b5084508',uuid=96b9a98d-d416-40ef-aa85-ce23ad77e9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converting VIF {"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ec:97,bridge_name='br-int',has_traffic_filtering=True,id=753db93c-97d2-463a-a3f4-052380c2c964,network=Network(09268389-e9b5-48c3-bd77-7d486a0f9ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap753db93c-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:ec:97"/><model type="virtio"/><mtu size="1442"/><target dev="tap753db93c-97"/></interface> {{(pid=73012) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:ec:97"/><model type="virtio"/><mtu size="1442"/><target dev="tap753db93c-97"/></interface> {{(pid=73012) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Attempting to detach device tap753db93c-97 from instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] detach device xml: <interface type="ethernet">
Aug 14 12:08:17 user nova-compute[73012]:   <mac address="fa:16:3e:5d:ec:97"/>
Aug 14 12:08:17 user nova-compute[73012]:   <model type="virtio"/>
Aug 14 12:08:17 user nova-compute[73012]:   <mtu size="1442"/>
Aug 14 12:08:17 user nova-compute[73012]:   <target dev="tap753db93c-97"/>
Aug 14 12:08:17 user nova-compute[73012]: </interface>
Aug 14 12:08:17 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:ec:97"/><model type="virtio"/><mtu size="1442"/><target dev="tap753db93c-97"/></interface> {{(pid=73012) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5d:ec:97"/><model type="virtio"/><mtu size="1442"/><target dev="tap753db93c-97"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 14 12:08:17 user nova-compute[73012]:   <name>instance-00000008</name>
Aug 14 12:08:17 user nova-compute[73012]:   <uuid>96b9a98d-d416-40ef-aa85-ce23ad77e9d7</uuid>
Aug 14 12:08:17 user nova-compute[73012]:   <metadata>
Aug 14 12:08:17 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:08:17 user nova-compute[73012]:   <nova:package version="0.0.0"/>
Aug 14 12:08:17 user nova-compute[73012]:   <nova:name>tempest-device-tagging-server-517741125</nova:name>
Aug 14 12:08:17 user nova-compute[73012]:   <nova:creationTime>2023-08-14 12:08:02</nova:creationTime>
Aug 14 12:08:17 user nova-compute[73012]:   <nova:flavor name="m1.tiny">
Aug 14 12:08:17 user nova-compute[73012]:     <nova:memory>512</nova:memory>
Aug 14 12:08:17 user nova-compute[73012]:     <nova:disk>1</nova:disk>
Aug 14 12:08:17 user nova-compute[73012]:     <nova:swap>0</nova:swap>
Aug 14 12:08:17 user nova-compute[73012]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:08:17 user nova-compute[73012]:     <nova:vcpus>1</nova:vcpus>
Aug 14 12:08:17 user nova-compute[73012]:   </nova:flavor>
Aug 14 12:08:17 user nova-compute[73012]:   <nova:owner>
Aug 14 12:08:17 user nova-compute[73012]:     <nova:user uuid="7bd40979075344b28d0223d4b5084508">tempest-TaggedAttachmentsTest-1305129888-project-member</nova:user>
Aug 14 12:08:17 user nova-compute[73012]:     <nova:project uuid="a60f4140fa9e464ba556f644132aad96">tempest-TaggedAttachmentsTest-1305129888</nova:project>
Aug 14 12:08:17 user nova-compute[73012]:   </nova:owner>
Aug 14 12:08:17 user nova-compute[73012]:   <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:08:17 user nova-compute[73012]:   <nova:ports>
Aug 14 12:08:17 user nova-compute[73012]:     <nova:port uuid="30ec13f3-55af-4216-a06e-63bc7b1fb9b6">
Aug 14 12:08:17 user nova-compute[73012]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:08:17 user nova-compute[73012]:     </nova:port>
Aug 14 12:08:17 user nova-compute[73012]:     <nova:port uuid="753db93c-97d2-463a-a3f4-052380c2c964">
Aug 14 12:08:17 user nova-compute[73012]:       <nova:ip type="fixed" address="10.10.10.54" ipVersion="4"/>
Aug 14 12:08:17 user nova-compute[73012]:     </nova:port>
Aug 14 12:08:17 user nova-compute[73012]:   </nova:ports>
Aug 14 12:08:17 user nova-compute[73012]: </nova:instance>
Aug 14 12:08:17 user nova-compute[73012]:   </metadata>
Aug 14 12:08:17 user nova-compute[73012]:   <memory unit='KiB'>524288</memory>
Aug 14 12:08:17 user nova-compute[73012]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 12:08:17 user nova-compute[73012]:   <vcpu placement='static'>1</vcpu>
Aug 14 12:08:17 user nova-compute[73012]:   <resource>
Aug 14 12:08:17 user nova-compute[73012]:     <partition>/machine</partition>
Aug 14 12:08:17 user nova-compute[73012]:   </resource>
Aug 14 12:08:17 user nova-compute[73012]:   <sysinfo type='smbios'>
Aug 14 12:08:17 user nova-compute[73012]:     <system>
Aug 14 12:08:17 user nova-compute[73012]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 12:08:17 user nova-compute[73012]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 12:08:17 user nova-compute[73012]:       <entry name='version'>0.0.0</entry>
Aug 14 12:08:17 user nova-compute[73012]:       <entry name='serial'>96b9a98d-d416-40ef-aa85-ce23ad77e9d7</entry>
Aug 14 12:08:17 user nova-compute[73012]:       <entry name='uuid'>96b9a98d-d416-40ef-aa85-ce23ad77e9d7</entry>
Aug 14 12:08:17 user nova-compute[73012]:       <entry name='family'>Virtual Machine</entry>
Aug 14 12:08:17 user nova-compute[73012]:     </system>
Aug 14 12:08:17 user nova-compute[73012]:   </sysinfo>
Aug 14 12:08:17 user nova-compute[73012]:   <os>
Aug 14 12:08:17 user nova-compute[73012]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 12:08:17 user nova-compute[73012]:     <boot dev='hd'/>
Aug 14 12:08:17 user nova-compute[73012]:     <smbios mode='sysinfo'/>
Aug 14 12:08:17 user nova-compute[73012]:   </os>
Aug 14 12:08:17 user nova-compute[73012]:   <features>
Aug 14 12:08:17 user nova-compute[73012]:     <acpi/>
Aug 14 12:08:17 user nova-compute[73012]:     <apic/>
Aug 14 12:08:17 user nova-compute[73012]:     <vmcoreinfo state='on'/>
Aug 14 12:08:17 user nova-compute[73012]:   </features>
Aug 14 12:08:17 user nova-compute[73012]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 12:08:17 user nova-compute[73012]:     <model fallback='forbid'>Nehalem</model>
Aug 14 12:08:17 user nova-compute[73012]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 12:08:17 user nova-compute[73012]:     <feature policy='require' name='vme'/>
Aug 14 12:08:17 user nova-compute[73012]:     <feature policy='require' name='x2apic'/>
Aug 14 12:08:17 user nova-compute[73012]:     <feature policy='require' name='hypervisor'/>
Aug 14 12:08:17 user nova-compute[73012]:   </cpu>
Aug 14 12:08:17 user nova-compute[73012]:   <clock offset='utc'>
Aug 14 12:08:17 user nova-compute[73012]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 12:08:17 user nova-compute[73012]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 12:08:17 user nova-compute[73012]:     <timer name='hpet' present='no'/>
Aug 14 12:08:17 user nova-compute[73012]:   </clock>
Aug 14 12:08:17 user nova-compute[73012]:   <on_poweroff>destroy</on_poweroff>
Aug 14 12:08:17 user nova-compute[73012]:   <on_reboot>restart</on_reboot>
Aug 14 12:08:17 user nova-compute[73012]:   <on_crash>destroy</on_crash>
Aug 14 12:08:17 user nova-compute[73012]:   <devices>
Aug 14 12:08:17 user nova-compute[73012]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 12:08:17 user nova-compute[73012]:     <disk type='file' device='disk'>
Aug 14 12:08:17 user nova-compute[73012]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 12:08:17 user nova-compute[73012]:       <source file='/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk' index='2'/>
Aug 14 12:08:17 user nova-compute[73012]:       <backingStore type='file' index='3'>
Aug 14 12:08:17 user nova-compute[73012]:         <format type='raw'/>
Aug 14 12:08:17 user nova-compute[73012]:         <source file='/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061'/>
Aug 14 12:08:17 user nova-compute[73012]:         <backingStore/>
Aug 14 12:08:17 user nova-compute[73012]:       </backingStore>
Aug 14 12:08:17 user nova-compute[73012]:       <target dev='vda' bus='virtio'/>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='virtio-disk0'/>
Aug 14 12:08:17 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </disk>
Aug 14 12:08:17 user nova-compute[73012]:     <disk type='file' device='cdrom'>
Aug 14 12:08:17 user nova-compute[73012]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 12:08:17 user nova-compute[73012]:       <source file='/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk.config' index='1'/>
Aug 14 12:08:17 user nova-compute[73012]:       <backingStore/>
Aug 14 12:08:17 user nova-compute[73012]:       <target dev='hda' bus='ide'/>
Aug 14 12:08:17 user nova-compute[73012]:       <readonly/>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='ide0-0-0'/>
Aug 14 12:08:17 user nova-compute[73012]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </disk>
Aug 14 12:08:17 user nova-compute[73012]:     <controller type='usb' index='0' model='none'>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='usb'/>
Aug 14 12:08:17 user nova-compute[73012]:     </controller>
Aug 14 12:08:17 user nova-compute[73012]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='pci.0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </controller>
Aug 14 12:08:17 user nova-compute[73012]:     <controller type='ide' index='0'>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='ide'/>
Aug 14 12:08:17 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 12:08:17 user nova-compute[73012]:     </controller>
Aug 14 12:08:17 user nova-compute[73012]:     <interface type='ethernet'>
Aug 14 12:08:17 user nova-compute[73012]:       <mac address='fa:16:3e:a2:ae:c8'/>
Aug 14 12:08:17 user nova-compute[73012]:       <target dev='tap30ec13f3-55'/>
Aug 14 12:08:17 user nova-compute[73012]:       <model type='virtio'/>
Aug 14 12:08:17 user nova-compute[73012]:       <mtu size='1442'/>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='net0'/>
Aug 14 12:08:17 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </interface>
Aug 14 12:08:17 user nova-compute[73012]:     <interface type='ethernet'>
Aug 14 12:08:17 user nova-compute[73012]:       <mac address='fa:16:3e:5d:ec:97'/>
Aug 14 12:08:17 user nova-compute[73012]:       <target dev='tap753db93c-97'/>
Aug 14 12:08:17 user nova-compute[73012]:       <model type='virtio'/>
Aug 14 12:08:17 user nova-compute[73012]:       <mtu size='1442'/>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='net1'/>
Aug 14 12:08:17 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </interface>
Aug 14 12:08:17 user nova-compute[73012]:     <serial type='pty'>
Aug 14 12:08:17 user nova-compute[73012]:       <source path='/dev/pts/7'/>
Aug 14 12:08:17 user nova-compute[73012]:       <log file='/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/console.log' append='off'/>
Aug 14 12:08:17 user nova-compute[73012]:       <target type='isa-serial' port='0'>
Aug 14 12:08:17 user nova-compute[73012]:         <model name='isa-serial'/>
Aug 14 12:08:17 user nova-compute[73012]:       </target>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='serial0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </serial>
Aug 14 12:08:17 user nova-compute[73012]:     <console type='pty' tty='/dev/pts/7'>
Aug 14 12:08:17 user nova-compute[73012]:       <source path='/dev/pts/7'/>
Aug 14 12:08:17 user nova-compute[73012]:       <log file='/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/console.log' append='off'/>
Aug 14 12:08:17 user nova-compute[73012]:       <target type='serial' port='0'/>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='serial0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </console>
Aug 14 12:08:17 user nova-compute[73012]:     <input type='mouse' bus='ps2'>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='input0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </input>
Aug 14 12:08:17 user nova-compute[73012]:     <input type='keyboard' bus='ps2'>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='input1'/>
Aug 14 12:08:17 user nova-compute[73012]:     </input>
Aug 14 12:08:17 user nova-compute[73012]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 14 12:08:17 user nova-compute[73012]:       <listen type='address' address='0.0.0.0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </graphics>
Aug 14 12:08:17 user nova-compute[73012]:     <audio id='1' type='none'/>
Aug 14 12:08:17 user nova-compute[73012]:     <video>
Aug 14 12:08:17 user nova-compute[73012]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='video0'/>
Aug 14 12:08:17 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </video>
Aug 14 12:08:17 user nova-compute[73012]:     <memballoon model='virtio'>
Aug 14 12:08:17 user nova-compute[73012]:       <stats period='10'/>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='balloon0'/>
Aug 14 12:08:17 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </memballoon>
Aug 14 12:08:17 user nova-compute[73012]:     <rng model='virtio'>
Aug 14 12:08:17 user nova-compute[73012]:       <backend model='random'>/dev/urandom</backend>
Aug 14 12:08:17 user nova-compute[73012]:       <alias name='rng0'/>
Aug 14 12:08:17 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 12:08:17 user nova-compute[73012]:     </rng>
Aug 14 12:08:17 user nova-compute[73012]:   </devices>
Aug 14 12:08:17 user nova-compute[73012]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 12:08:17 user nova-compute[73012]:     <label>libvirt-96b9a98d-d416-40ef-aa85-ce23ad77e9d7</label>
Aug 14 12:08:17 user nova-compute[73012]:     <imagelabel>libvirt-96b9a98d-d416-40ef-aa85-ce23ad77e9d7</imagelabel>
Aug 14 12:08:17 user nova-compute[73012]:   </seclabel>
Aug 14 12:08:17 user nova-compute[73012]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 12:08:17 user nova-compute[73012]:     <label>+64055:+108</label>
Aug 14 12:08:17 user nova-compute[73012]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 12:08:17 user nova-compute[73012]:   </seclabel>
Aug 14 12:08:17 user nova-compute[73012]: </domain>
Aug 14 12:08:17 user nova-compute[73012]:  {{(pid=73012) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 12:08:17 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Successfully detached device tap753db93c-97 from instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 from the persistent domain config.
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] (1/8): Attempting to detach device tap753db93c-97 with device alias net1 from instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] detach device xml: <interface type="ethernet">
Aug 14 12:08:17 user nova-compute[73012]:   <mac address="fa:16:3e:5d:ec:97"/>
Aug 14 12:08:17 user nova-compute[73012]:   <model type="virtio"/>
Aug 14 12:08:17 user nova-compute[73012]:   <mtu size="1442"/>
Aug 14 12:08:17 user nova-compute[73012]:   <target dev="tap753db93c-97"/>
Aug 14 12:08:17 user nova-compute[73012]: </interface>
Aug 14 12:08:17 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692014898.0011327, 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Start waiting for the detach event from libvirt for device tap753db93c-97 with device alias net1 for instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5d:ec:97"/><model type="virtio"/><mtu size="1442"/><target dev="tap753db93c-97"/></interface> {{(pid=73012) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5d:ec:97"/><model type="virtio"/><mtu size="1442"/><target dev="tap753db93c-97"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 14 12:08:18 user nova-compute[73012]:   <name>instance-00000008</name>
Aug 14 12:08:18 user nova-compute[73012]:   <uuid>96b9a98d-d416-40ef-aa85-ce23ad77e9d7</uuid>
Aug 14 12:08:18 user nova-compute[73012]:   <metadata>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:08:18 user nova-compute[73012]:   <nova:package version="0.0.0"/>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:name>tempest-device-tagging-server-517741125</nova:name>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:creationTime>2023-08-14 12:08:02</nova:creationTime>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:flavor name="m1.tiny">
Aug 14 12:08:18 user nova-compute[73012]:     <nova:memory>512</nova:memory>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:disk>1</nova:disk>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:swap>0</nova:swap>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:vcpus>1</nova:vcpus>
Aug 14 12:08:18 user nova-compute[73012]:   </nova:flavor>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:owner>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:user uuid="7bd40979075344b28d0223d4b5084508">tempest-TaggedAttachmentsTest-1305129888-project-member</nova:user>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:project uuid="a60f4140fa9e464ba556f644132aad96">tempest-TaggedAttachmentsTest-1305129888</nova:project>
Aug 14 12:08:18 user nova-compute[73012]:   </nova:owner>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:ports>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:port uuid="30ec13f3-55af-4216-a06e-63bc7b1fb9b6">
Aug 14 12:08:18 user nova-compute[73012]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:08:18 user nova-compute[73012]:     </nova:port>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:port uuid="753db93c-97d2-463a-a3f4-052380c2c964">
Aug 14 12:08:18 user nova-compute[73012]:       <nova:ip type="fixed" address="10.10.10.54" ipVersion="4"/>
Aug 14 12:08:18 user nova-compute[73012]:     </nova:port>
Aug 14 12:08:18 user nova-compute[73012]:   </nova:ports>
Aug 14 12:08:18 user nova-compute[73012]: </nova:instance>
Aug 14 12:08:18 user nova-compute[73012]:   </metadata>
Aug 14 12:08:18 user nova-compute[73012]:   <memory unit='KiB'>524288</memory>
Aug 14 12:08:18 user nova-compute[73012]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 12:08:18 user nova-compute[73012]:   <vcpu placement='static'>1</vcpu>
Aug 14 12:08:18 user nova-compute[73012]:   <resource>
Aug 14 12:08:18 user nova-compute[73012]:     <partition>/machine</partition>
Aug 14 12:08:18 user nova-compute[73012]:   </resource>
Aug 14 12:08:18 user nova-compute[73012]:   <sysinfo type='smbios'>
Aug 14 12:08:18 user nova-compute[73012]:     <system>
Aug 14 12:08:18 user nova-compute[73012]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 12:08:18 user nova-compute[73012]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 12:08:18 user nova-compute[73012]:       <entry name='version'>0.0.0</entry>
Aug 14 12:08:18 user nova-compute[73012]:       <entry name='serial'>96b9a98d-d416-40ef-aa85-ce23ad77e9d7</entry>
Aug 14 12:08:18 user nova-compute[73012]:       <entry name='uuid'>96b9a98d-d416-40ef-aa85-ce23ad77e9d7</entry>
Aug 14 12:08:18 user nova-compute[73012]:       <entry name='family'>Virtual Machine</entry>
Aug 14 12:08:18 user nova-compute[73012]:     </system>
Aug 14 12:08:18 user nova-compute[73012]:   </sysinfo>
Aug 14 12:08:18 user nova-compute[73012]:   <os>
Aug 14 12:08:18 user nova-compute[73012]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 12:08:18 user nova-compute[73012]:     <boot dev='hd'/>
Aug 14 12:08:18 user nova-compute[73012]:     <smbios mode='sysinfo'/>
Aug 14 12:08:18 user nova-compute[73012]:   </os>
Aug 14 12:08:18 user nova-compute[73012]:   <features>
Aug 14 12:08:18 user nova-compute[73012]:     <acpi/>
Aug 14 12:08:18 user nova-compute[73012]:     <apic/>
Aug 14 12:08:18 user nova-compute[73012]:     <vmcoreinfo state='on'/>
Aug 14 12:08:18 user nova-compute[73012]:   </features>
Aug 14 12:08:18 user nova-compute[73012]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 12:08:18 user nova-compute[73012]:     <model fallback='forbid'>Nehalem</model>
Aug 14 12:08:18 user nova-compute[73012]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 12:08:18 user nova-compute[73012]:     <feature policy='require' name='vme'/>
Aug 14 12:08:18 user nova-compute[73012]:     <feature policy='require' name='x2apic'/>
Aug 14 12:08:18 user nova-compute[73012]:     <feature policy='require' name='hypervisor'/>
Aug 14 12:08:18 user nova-compute[73012]:   </cpu>
Aug 14 12:08:18 user nova-compute[73012]:   <clock offset='utc'>
Aug 14 12:08:18 user nova-compute[73012]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 12:08:18 user nova-compute[73012]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 12:08:18 user nova-compute[73012]:     <timer name='hpet' present='no'/>
Aug 14 12:08:18 user nova-compute[73012]:   </clock>
Aug 14 12:08:18 user nova-compute[73012]:   <on_poweroff>destroy</on_poweroff>
Aug 14 12:08:18 user nova-compute[73012]:   <on_reboot>restart</on_reboot>
Aug 14 12:08:18 user nova-compute[73012]:   <on_crash>destroy</on_crash>
Aug 14 12:08:18 user nova-compute[73012]:   <devices>
Aug 14 12:08:18 user nova-compute[73012]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 12:08:18 user nova-compute[73012]:     <disk type='file' device='disk'>
Aug 14 12:08:18 user nova-compute[73012]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 12:08:18 user nova-compute[73012]:       <source file='/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk' index='2'/>
Aug 14 12:08:18 user nova-compute[73012]:       <backingStore type='file' index='3'>
Aug 14 12:08:18 user nova-compute[73012]:         <format type='raw'/>
Aug 14 12:08:18 user nova-compute[73012]:         <source file='/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061'/>
Aug 14 12:08:18 user nova-compute[73012]:         <backingStore/>
Aug 14 12:08:18 user nova-compute[73012]:       </backingStore>
Aug 14 12:08:18 user nova-compute[73012]:       <target dev='vda' bus='virtio'/>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='virtio-disk0'/>
Aug 14 12:08:18 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </disk>
Aug 14 12:08:18 user nova-compute[73012]:     <disk type='file' device='cdrom'>
Aug 14 12:08:18 user nova-compute[73012]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 12:08:18 user nova-compute[73012]:       <source file='/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk.config' index='1'/>
Aug 14 12:08:18 user nova-compute[73012]:       <backingStore/>
Aug 14 12:08:18 user nova-compute[73012]:       <target dev='hda' bus='ide'/>
Aug 14 12:08:18 user nova-compute[73012]:       <readonly/>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='ide0-0-0'/>
Aug 14 12:08:18 user nova-compute[73012]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </disk>
Aug 14 12:08:18 user nova-compute[73012]:     <controller type='usb' index='0' model='none'>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='usb'/>
Aug 14 12:08:18 user nova-compute[73012]:     </controller>
Aug 14 12:08:18 user nova-compute[73012]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='pci.0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </controller>
Aug 14 12:08:18 user nova-compute[73012]:     <controller type='ide' index='0'>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='ide'/>
Aug 14 12:08:18 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 12:08:18 user nova-compute[73012]:     </controller>
Aug 14 12:08:18 user nova-compute[73012]:     <interface type='ethernet'>
Aug 14 12:08:18 user nova-compute[73012]:       <mac address='fa:16:3e:a2:ae:c8'/>
Aug 14 12:08:18 user nova-compute[73012]:       <target dev='tap30ec13f3-55'/>
Aug 14 12:08:18 user nova-compute[73012]:       <model type='virtio'/>
Aug 14 12:08:18 user nova-compute[73012]:       <mtu size='1442'/>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='net0'/>
Aug 14 12:08:18 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </interface>
Aug 14 12:08:18 user nova-compute[73012]:     <serial type='pty'>
Aug 14 12:08:18 user nova-compute[73012]:       <source path='/dev/pts/7'/>
Aug 14 12:08:18 user nova-compute[73012]:       <log file='/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/console.log' append='off'/>
Aug 14 12:08:18 user nova-compute[73012]:       <target type='isa-serial' port='0'>
Aug 14 12:08:18 user nova-compute[73012]:         <model name='isa-serial'/>
Aug 14 12:08:18 user nova-compute[73012]:       </target>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='serial0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </serial>
Aug 14 12:08:18 user nova-compute[73012]:     <console type='pty' tty='/dev/pts/7'>
Aug 14 12:08:18 user nova-compute[73012]:       <source path='/dev/pts/7'/>
Aug 14 12:08:18 user nova-compute[73012]:       <log file='/opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/console.log' append='off'/>
Aug 14 12:08:18 user nova-compute[73012]:       <target type='serial' port='0'/>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='serial0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </console>
Aug 14 12:08:18 user nova-compute[73012]:     <input type='mouse' bus='ps2'>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='input0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </input>
Aug 14 12:08:18 user nova-compute[73012]:     <input type='keyboard' bus='ps2'>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='input1'/>
Aug 14 12:08:18 user nova-compute[73012]:     </input>
Aug 14 12:08:18 user nova-compute[73012]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 14 12:08:18 user nova-compute[73012]:       <listen type='address' address='0.0.0.0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </graphics>
Aug 14 12:08:18 user nova-compute[73012]:     <audio id='1' type='none'/>
Aug 14 12:08:18 user nova-compute[73012]:     <video>
Aug 14 12:08:18 user nova-compute[73012]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='video0'/>
Aug 14 12:08:18 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </video>
Aug 14 12:08:18 user nova-compute[73012]:     <memballoon model='virtio'>
Aug 14 12:08:18 user nova-compute[73012]:       <stats period='10'/>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='balloon0'/>
Aug 14 12:08:18 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </memballoon>
Aug 14 12:08:18 user nova-compute[73012]:     <rng model='virtio'>
Aug 14 12:08:18 user nova-compute[73012]:       <backend model='random'>/dev/urandom</backend>
Aug 14 12:08:18 user nova-compute[73012]:       <alias name='rng0'/>
Aug 14 12:08:18 user nova-compute[73012]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 12:08:18 user nova-compute[73012]:     </rng>
Aug 14 12:08:18 user nova-compute[73012]:   </devices>
Aug 14 12:08:18 user nova-compute[73012]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 12:08:18 user nova-compute[73012]:     <label>libvirt-96b9a98d-d416-40ef-aa85-ce23ad77e9d7</label>
Aug 14 12:08:18 user nova-compute[73012]:     <imagelabel>libvirt-96b9a98d-d416-40ef-aa85-ce23ad77e9d7</imagelabel>
Aug 14 12:08:18 user nova-compute[73012]:   </seclabel>
Aug 14 12:08:18 user nova-compute[73012]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 12:08:18 user nova-compute[73012]:     <label>+64055:+108</label>
Aug 14 12:08:18 user nova-compute[73012]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 12:08:18 user nova-compute[73012]:   </seclabel>
Aug 14 12:08:18 user nova-compute[73012]: </domain>
Aug 14 12:08:18 user nova-compute[73012]:  {{(pid=73012) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 12:08:18 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Successfully detached device tap753db93c-97 from instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 from the live domain config.
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517741125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517741125',id=8,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2TTpmfaQPgY9ohNbVadAHJOLiNi1lPNazCQ0/vgYaopsQex8HgTVtrzr1PsGl+iZ8XzkXNAGaX1YvJAn1t8iAMrG6pCLvmKBNfbkLxAoKRO+zDopEQxka9+HZl/6dPMQ==',key_name='tempest-keypair-779145758',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a60f4140fa9e464ba556f644132aad96',ramdisk_id='',reservation_id='r-7nj3lvpu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1305129888',owner_user_name='tempest-TaggedAttachmentsTest-1305129888-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd40979075344b28d0223d4b5084508',uuid=96b9a98d-d416-40ef-aa85-ce23ad77e9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converting VIF {"id": "753db93c-97d2-463a-a3f4-052380c2c964", "address": "fa:16:3e:5d:ec:97", "network": {"id": "09268389-e9b5-48c3-bd77-7d486a0f9ffb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-427668552", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap753db93c-97", "ovs_interfaceid": "753db93c-97d2-463a-a3f4-052380c2c964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ec:97,bridge_name='br-int',has_traffic_filtering=True,id=753db93c-97d2-463a-a3f4-052380c2c964,network=Network(09268389-e9b5-48c3-bd77-7d486a0f9ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap753db93c-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG os_vif [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ec:97,bridge_name='br-int',has_traffic_filtering=True,id=753db93c-97d2-463a-a3f4-052380c2c964,network=Network(09268389-e9b5-48c3-bd77-7d486a0f9ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap753db93c-97') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap753db93c-97, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692014883.02339, 273c3cd7-3897-4079-821b-b477102fd7ba => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:08:18 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] VM Stopped (Lifecycle Event)
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1661d92e-c5e7-47f1-85c1-388aa895c8d9 None None] [instance: 273c3cd7-3897-4079-821b-b477102fd7ba] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:18 user nova-compute[73012]: INFO os_vif [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ec:97,bridge_name='br-int',has_traffic_filtering=True,id=753db93c-97d2-463a-a3f4-052380c2c964,network=Network(09268389-e9b5-48c3-bd77-7d486a0f9ffb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap753db93c-97')
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:08:18 user nova-compute[73012]:   <nova:package version="0.0.0"/>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:name>tempest-device-tagging-server-517741125</nova:name>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:creationTime>2023-08-14 12:08:18</nova:creationTime>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:flavor name="m1.tiny">
Aug 14 12:08:18 user nova-compute[73012]:     <nova:memory>512</nova:memory>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:disk>1</nova:disk>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:swap>0</nova:swap>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:vcpus>1</nova:vcpus>
Aug 14 12:08:18 user nova-compute[73012]:   </nova:flavor>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:owner>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:user uuid="7bd40979075344b28d0223d4b5084508">tempest-TaggedAttachmentsTest-1305129888-project-member</nova:user>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:project uuid="a60f4140fa9e464ba556f644132aad96">tempest-TaggedAttachmentsTest-1305129888</nova:project>
Aug 14 12:08:18 user nova-compute[73012]:   </nova:owner>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:08:18 user nova-compute[73012]:   <nova:ports>
Aug 14 12:08:18 user nova-compute[73012]:     <nova:port uuid="30ec13f3-55af-4216-a06e-63bc7b1fb9b6">
Aug 14 12:08:18 user nova-compute[73012]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:08:18 user nova-compute[73012]:     </nova:port>
Aug 14 12:08:18 user nova-compute[73012]:   </nova:ports>
Aug 14 12:08:18 user nova-compute[73012]: </nova:instance>
Aug 14 12:08:18 user nova-compute[73012]:  {{(pid=73012) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-39f060bd-7ce0-40bd-ae92-cd45940cfcf2 req-f207fa3d-6644-4a24-b71d-d6a1e8da209e service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-unplugged-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-39f060bd-7ce0-40bd-ae92-cd45940cfcf2 req-f207fa3d-6644-4a24-b71d-d6a1e8da209e service nova] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-39f060bd-7ce0-40bd-ae92-cd45940cfcf2 req-f207fa3d-6644-4a24-b71d-d6a1e8da209e service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-39f060bd-7ce0-40bd-ae92-cd45940cfcf2 req-f207fa3d-6644-4a24-b71d-d6a1e8da209e service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-39f060bd-7ce0-40bd-ae92-cd45940cfcf2 req-f207fa3d-6644-4a24-b71d-d6a1e8da209e service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] No waiting events found dispatching network-vif-unplugged-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:18 user nova-compute[73012]: WARNING nova.compute.manager [req-39f060bd-7ce0-40bd-ae92-cd45940cfcf2 req-f207fa3d-6644-4a24-b71d-d6a1e8da209e service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received unexpected event network-vif-unplugged-753db93c-97d2-463a-a3f4-052380c2c964 for instance with vm_state active and task_state None.
Aug 14 12:08:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquired lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:18 user nova-compute[73012]: DEBUG nova.network.neutron [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:08:19 user nova-compute[73012]: INFO nova.network.neutron [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Port 753db93c-97d2-463a-a3f4-052380c2c964 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 14 12:08:19 user nova-compute[73012]: DEBUG nova.network.neutron [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updating instance_info_cache with network_info: [{"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Releasing lock "refresh_cache-96b9a98d-d416-40ef-aa85-ce23ad77e9d7" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-80f0e855-a9bb-4f2e-bd8f-c66150362921 tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "interface-96b9a98d-d416-40ef-aa85-ce23ad77e9d7-753db93c-97d2-463a-a3f4-052380c2c964" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.646s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBbgfQPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874', 'attached_at': '', 'detached_at': '', 'volume_id': '9fad420e-430a-4acf-9478-2815226f8cd1', 'serial': '9fad420e-430a-4acf-9478-2815226f8cd1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGDpsTBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7306760-6967-4276-9e27-89ea1b0dabe1', 'serial'} {{(pid=73012) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBbgfQPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:20 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:20 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:20 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[95692177-68bf-4adb-ac60-1b8d485198f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:08:20 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7d86d4-699d-4036-baeb-1de56092a568]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1] added
Aug 14 12:08:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e995cd08-616a-4f31-863c-2f46a2db2ddf]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d964f6e5-455e-4348-86d5-9e30c677986a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBbgfQPl {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBbgfQPl" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87d7d5b-0f32-41ad-9a48-2433ba56af32]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UBbgfQPl'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e3e2b-9692-4c8a-a77b-51b5be4c4951]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2827509-a9d3-4e93-be7a-56f377ec2b81]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:20 user nova-compute[73012]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:08:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:20 user nova-compute[73012]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:08:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-c8b8ed91-cc41-40ef-a421-944806b399aa req-827a00bc-604c-4253-9bb5-99b98c6c4d11 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-plugged-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c8b8ed91-cc41-40ef-a421-944806b399aa req-827a00bc-604c-4253-9bb5-99b98c6c4d11 service nova] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c8b8ed91-cc41-40ef-a421-944806b399aa req-827a00bc-604c-4253-9bb5-99b98c6c4d11 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c8b8ed91-cc41-40ef-a421-944806b399aa req-827a00bc-604c-4253-9bb5-99b98c6c4d11 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-c8b8ed91-cc41-40ef-a421-944806b399aa req-827a00bc-604c-4253-9bb5-99b98c6c4d11 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] No waiting events found dispatching network-vif-plugged-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:20 user nova-compute[73012]: WARNING nova.compute.manager [req-c8b8ed91-cc41-40ef-a421-944806b399aa req-827a00bc-604c-4253-9bb5-99b98c6c4d11 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received unexpected event network-vif-plugged-753db93c-97d2-463a-a3f4-052380c2c964 for instance with vm_state active and task_state None.
Aug 14 12:08:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-c8b8ed91-cc41-40ef-a421-944806b399aa req-827a00bc-604c-4253-9bb5-99b98c6c4d11 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-deleted-753db93c-97d2-463a-a3f4-052380c2c964 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f266173-bbc0-434c-912a-f540ad297c7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1, portal: 172.16.0.220,3260]
Aug 14 12:08:20 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3664fb4-d745-4e12-9137-a1a2ea835724]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6818b72e-2707-453f-8e35-d7c85c417d6a]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:20 user nova-compute[73012]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:08:20 user nova-compute[73012]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:20 user nova-compute[73012]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:08:20 user nova-compute[73012]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea47a1c-ae66-4240-b8ba-bac239314174]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:08:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBbgfQPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:08:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23363336535356433', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363336535356433', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:08:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lazy-loading 'flavor' on Instance uuid ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:08:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 34603008 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 90177536 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:08:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:08:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:23 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:08:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 189792256 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 277872640 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 324009984 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 328204288 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 452984832 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 580911104 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 764411904 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 893386752 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:28 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:08:28 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=25.6767578125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGDpsTBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:28 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 76214f3b-ceb8-4443-b70e-1dc6e0a11217 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 155f4cf4-3bfd-4529-bb26-529a500e61eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87fa656-2ebe-4404-8f70-d2298d094198]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac90364-3b32-4f0d-a3c5-dc8937aebf7b]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:28 user nova-compute[73012]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:28 user nova-compute[73012]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad06c65f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[91622b2e-7635-4180-ac47-0b02d90644f4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06014d5-92c6-4833-a71d-3b187613716c]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[20afcccf-a417-4311-9957-f7b7fa040b2b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0fca1a-2244-4be4-9f21-ddb0be2906ae]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d172b4c9-932e-4714-8a63-fccbab6b01fb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae1e7c8-3713-44f2-a6ea-cc2dd97a9a58]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260]
Aug 14 12:08:28 user nova-compute[73012]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dff15b-ee4b-4607-acb5-34f0de4fee94]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] <== disconnect_volume: return (321ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBbgfQPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874', 'attached_at': '', 'detached_at': '', 'volume_id': '9fad420e-430a-4acf-9478-2815226f8cd1', 'serial'} {{(pid=73012) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] swap_volume: removing Cinder connection for volume d7306760-6967-4276-9e27-89ea1b0dabe1 {{(pid=73012) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:08:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:08:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] swap_volume: Updating volume d7306760-6967-4276-9e27-89ea1b0dabe1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "UBbgfQPl", "auth_password": "0dIaPgp1DyCvJz", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "9fad420e-430a-4acf-9478-2815226f8cd1"}, "status": "reserved", "instance": "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874", "attached_at": "", "detached_at": "", "volume_id": "9fad420e-430a-4acf-9478-2815226f8cd1", "serial": "9fad420e-430a-4acf-9478-2815226f8cd1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9fad420e-430a-4acf-9478-2815226f8cd1', 'no_device': None, 'attachment_id': 'edb95238-e97e-4b58-b13b-d50416017462'} {{(pid=73012) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 12:08:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-92bfc191-6f3a-41c3-a3a2-7cbb08d46efd tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.673s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG os_brick.utils [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd16211-7fbe-4979-9bd2-f6c05791a3c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[81985431-c31b-4f25-b6f1-c6070af188bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83b4971-c253-4009-a077-dc12a61a7d25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e19c3f-9b97-4f98-bc55-1096bf78b779]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:08:30 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:08:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[99623233-0bd8-48ca-836e-db2f9c2a2bba]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:08:30 user nova-compute[73012]: DEBUG os_brick.utils [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:30 user nova-compute[73012]: INFO nova.compute.manager [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Swapping volume 9fad420e-430a-4acf-9478-2815226f8cd1 for d7306760-6967-4276-9e27-89ea1b0dabe1
Aug 14 12:08:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:08:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:08:36 user nova-compute[73012]: INFO nova.compute.claims [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Claim successful on node user
Aug 14 12:08:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG nova.network.neutron [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:08:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:08:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:08:37 user nova-compute[73012]: INFO nova.virt.block_device [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Booting with volume ae658aa7-5072-4837-a2ba-a4221136e98b at /dev/vda
Aug 14 12:08:37 user nova-compute[73012]: DEBUG nova.policy [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab939cda27a1447088d51c94b161f4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44af87d2aa64185ad02ba16d7cfe6b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:37 user nova-compute[73012]: INFO nova.compute.manager [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Terminating instance
Aug 14 12:08:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG os_brick.utils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fcb34a-14ff-4588-91b0-f1d355fd1e08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb741cd-8198-4777-bc9a-e1c677a83a55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[10153763-26fb-494a-b772-b5ce14414aa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e96402-260b-49f2-b3db-a1d9c40e1523]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:08:37 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:08:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b6b570-6039-4757-92a5-61d65ab69e33]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG os_brick.utils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating existing volume attachment record: 6e3322c9-418e-4cf0-b9ea-d1ce75def592 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:08:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-0272daa8-cbeb-4272-8651-dfe56a80abc6 req-bc25ed0f-5883-40f8-a3b1-b0a6275729fa service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received event network-vif-unplugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0272daa8-cbeb-4272-8651-dfe56a80abc6 req-bc25ed0f-5883-40f8-a3b1-b0a6275729fa service nova] Acquiring lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0272daa8-cbeb-4272-8651-dfe56a80abc6 req-bc25ed0f-5883-40f8-a3b1-b0a6275729fa service nova] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0272daa8-cbeb-4272-8651-dfe56a80abc6 req-bc25ed0f-5883-40f8-a3b1-b0a6275729fa service nova] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-0272daa8-cbeb-4272-8651-dfe56a80abc6 req-bc25ed0f-5883-40f8-a3b1-b0a6275729fa service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] No waiting events found dispatching network-vif-unplugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-0272daa8-cbeb-4272-8651-dfe56a80abc6 req-bc25ed0f-5883-40f8-a3b1-b0a6275729fa service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received event network-vif-unplugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:08:38 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Instance destroyed successfully.
Aug 14 12:08:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lazy-loading 'resources' on Instance uuid 76214f3b-ceb8-4443-b70e-1dc6e0a11217 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-768619710',display_name='tempest-VolumesActionsTest-instance-768619710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-768619710',id=9,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:06:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5abf0cec2b9b4977ba86d806058ec6df',ramdisk_id='',reservation_id='r-0903ggsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-793579565',owner_user_name='tempest-VolumesActionsTest-793579565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:06:53Z,user_data=None,user_id='a52866e21ac4407eb3004b69a38ce75b',uuid=76214f3b-ceb8-4443-b70e-1dc6e0a11217,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converting VIF {"id": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "address": "fa:16:3e:f3:53:e0", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b08e63-95", "ovs_interfaceid": "22b08e63-95c9-42e4-9c73-b99cbb8cf21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:e0,bridge_name='br-int',has_traffic_filtering=True,id=22b08e63-95c9-42e4-9c73-b99cbb8cf21b,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b08e63-95') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG os_vif [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:e0,bridge_name='br-int',has_traffic_filtering=True,id=22b08e63-95c9-42e4-9c73-b99cbb8cf21b,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b08e63-95') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22b08e63-95, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:08:38 user nova-compute[73012]: INFO os_vif [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:e0,bridge_name='br-int',has_traffic_filtering=True,id=22b08e63-95c9-42e4-9c73-b99cbb8cf21b,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b08e63-95')
Aug 14 12:08:38 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Deleting instance files /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217_del
Aug 14 12:08:38 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Deletion of /opt/stack/data/nova/instances/76214f3b-ceb8-4443-b70e-1dc6e0a11217_del complete
Aug 14 12:08:38 user nova-compute[73012]: INFO nova.compute.manager [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 12:08:38 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:08:38 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:08:39 user nova-compute[73012]: DEBUG nova.network.neutron [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Successfully created port: 93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:08:39 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:39 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Took 0.76 seconds to deallocate network for instance.
Aug 14 12:08:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-cf5fdd57-6ca0-46bc-b098-30e624ae6d60 req-070951e3-0e94-49e8-828e-e3a7bfbf9bbc service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received event network-vif-deleted-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:39 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:08:39 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:08:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:39 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Deleted allocations for instance 76214f3b-ceb8-4443-b70e-1dc6e0a11217
Aug 14 12:08:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-790403d9-aa08-4054-97b0-3189ff3de1e4 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGDpsTBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7306760-6967-4276-9e27-89ea1b0dabe1', 'serial': 'd7306760-6967-4276-9e27-89ea1b0dabe1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBbgfQPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '9fad420e-430a-4acf-9478-2815226f8cd1'}, 'status': 'reserved', 'instance': 'ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874', 'attached_at': '', 'detached_at': '', 'volume_id': '9fad420e-430a-4acf-9478-2815226f8cd1', 'serial'} {{(pid=73012) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGDpsTBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:40 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:40 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:40 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[601b6923-f1ab-4de6-906f-dd2bada33db1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:08:40 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a9d1c0-994f-44aa-9bca-3817c0982443]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1] added
Aug 14 12:08:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c78832b-348c-466f-8745-22f0af1f3f74]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4250e8f8-8a2e-481f-a5da-93c04f8cbc95]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGDpsTBz {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGDpsTBz" returned: 0 in 0.051s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[46db658e-7316-4dc7-866d-1e0a8426f2c4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LGDpsTBz'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fe4316-7ad0-4ee1-bfeb-dc3f1f57ea81]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d051fb-56c2-45b1-b0f2-064cff92dcc2]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb636a4-a6b1-4a13-83de-537ccffa2c32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260]
Aug 14 12:08:40 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95c5cbf-7e55-4ee5-a20d-13cee51fb118]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG nova.network.neutron [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Successfully updated port: 93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquired lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG nova.network.neutron [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4127a318-5dcf-4576-9eb9-179c37657df8]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:40 user nova-compute[73012]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:40 user nova-compute[73012]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79a26d1-728d-4da1-9949-3a01d1268f0c]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received event network-vif-plugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] Acquiring lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] Lock "76214f3b-ceb8-4443-b70e-1dc6e0a11217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] No waiting events found dispatching network-vif-plugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:40 user nova-compute[73012]: WARNING nova.compute.manager [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Received unexpected event network-vif-plugged-22b08e63-95c9-42e4-9c73-b99cbb8cf21b for instance with vm_state deleted and task_state None.
Aug 14 12:08:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-changed-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing instance network info cache due to event network-changed-93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] Acquiring lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:40 user nova-compute[73012]: DEBUG nova.network.neutron [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG nova.network.neutron [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating instance_info_cache with network_info: [{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Releasing lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance network_info: |[{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] Acquired lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG nova.network.neutron [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGDpsTBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26266343831343138', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266343831343138', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG nova.objects.instance [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lazy-loading 'flavor' on Instance uuid ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updated VIF entry in instance network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:08:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating instance_info_cache with network_info: [{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7db38ed0-b64c-43be-ac24-763940be54b7 req-59c8b382-cc68-494a-b687-69ec8b762085 service nova] Releasing lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 103809024 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 249561088 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 371195904 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 538968064 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 680525824 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 729808896 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 878706688 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 1035993088 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBbgfQPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '9fad420e-430a-4acf-9478-2815226f8cd1'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:46 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8b8dfd-f636-40a1-9252-50a87dae978e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de1af17-4856-4e64-b7ca-adb60696f4b9]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:46 user nova-compute[73012]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 (non-flash)
Aug 14 12:08:46 user nova-compute[73012]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad050f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fba0ca-03f5-4400-97e8-b90387736330]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[39037be1-0c72-467a-8c00-a6bd541f34f8]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa979f8-f637-4326-a9bd-7b334d0c22b0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:08:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29cb4f7-2602-4ae0-b38b-5ca2a202fb8d]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[27942859-ecb4-4a5d-9b5f-aeda9d078877]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f9ea82-91ad-414c-b895-ec1af9871fd6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1, portal: 172.16.0.220,3260]
Aug 14 12:08:47 user nova-compute[73012]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:47 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fad420e-430a-4acf-9478-2815226f8cd1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd31fc3-a893-4a8a-baa7-d9d9c7e3cbd4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] <== disconnect_volume: return (310ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGDpsTBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7306760-6967-4276-9e27-89ea1b0dabe1', 'serial'} {{(pid=73012) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] swap_volume: removing Cinder connection for volume 9fad420e-430a-4acf-9478-2815226f8cd1 {{(pid=73012) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "29b69875-6f7d-47e1-b254-8f01e07fffa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:08:48 user nova-compute[73012]: INFO nova.compute.claims [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Claim successful on node user
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] swap_volume: Updating volume 9fad420e-430a-4acf-9478-2815226f8cd1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "LGDpsTBz", "auth_password": "8jdnVQY4y5z9XA", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "d7306760-6967-4276-9e27-89ea1b0dabe1"}, "status": "reserved", "instance": "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874", "attached_at": "", "detached_at": "", "volume_id": "d7306760-6967-4276-9e27-89ea1b0dabe1", "serial": "d7306760-6967-4276-9e27-89ea1b0dabe1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd7306760-6967-4276-9e27-89ea1b0dabe1', 'no_device': None, 'attachment_id': '2f141deb-a7d5-4486-8d76-197d4cfcf5ab'} {{(pid=73012) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8fcfb7d3-e7b6-49f5-8a0a-85799af78c54 tempest-TestVolumeSwap-1408276368 tempest-TestVolumeSwap-1408276368-project-admin] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.344s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:08:48 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:08:48 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Creating image(s)
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "/opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "/opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "/opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.policy [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9442db73842a465493b2e020a0977cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2210f703a6814803bcfb4266d264b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:08:48 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Creating image(s)
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Ensure instance console log exists: /opt/stack/data/nova/instances/dadd3d4a-74da-416f-935c-2b064ea2ec16/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Start _get_guest_xml network_info=[{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMgAODHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dadd3d4a-74da-416f-935c-2b064ea2ec16', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae658aa7-5072-4837-a2ba-a4221136e98b', 'serial': 'ae658aa7-5072-4837-a2ba-a4221136e98b'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '6e3322c9-418e-4cf0-b9ea-d1ce75def592', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:08:48 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:08:48 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:08:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMgAODHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:49 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:49 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:49 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b5d9b4-ce46-4906-ac3e-78f832ac2a01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:08:49 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a746a27d-2a12-4342-ac6f-d2e8e4aa9c4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b] added
Aug 14 12:08:49 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220ba52-d67e-46f5-ac35-28bd9a0453fd]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c84f921-3f6d-406c-b8eb-bd33051add37]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMgAODHz {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.223s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMgAODHz" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d907414d-a0f9-4aff-a18b-099cef52b86e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WMgAODHz'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk 1073741824" returned: 0 in 0.052s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b522d6f-f5bb-4e6e-8a55-58fb551d3329]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e386f43-b290-4970-8aff-1202e0e9b8a4]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:49 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:49 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9505aee-aa23-47c8-bdb4-b9327c6382b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260]
Aug 14 12:08:49 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:49 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.231s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.096s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[499379f1-68a4-4483-909a-985dd17efdec]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[45916377-0269-4cb4-8e95-b1cd2747b086]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:08:49 user nova-compute[73012]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:49 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:08:49 user nova-compute[73012]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:49 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.461s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Successfully created port: bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade4d08d-d152-4c5a-8c8e-49314f91e89f]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMgAODHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Cannot resize image /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.objects.instance [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lazy-loading 'migration_context' on Instance uuid 29b69875-6f7d-47e1-b254-8f01e07fffa3 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Ensure instance console log exists: /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:49 user nova-compute[73012]: INFO nova.compute.manager [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Detaching volume d7306760-6967-4276-9e27-89ea1b0dabe1
Aug 14 12:08:49 user nova-compute[73012]: INFO nova.virt.block_device [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Attempting to driver detach volume d7306760-6967-4276-9e27-89ea1b0dabe1 from mountpoint /dev/vdb
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Attempting to detach device vdb from instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:08:49 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:49 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:08:49 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:08:49 user nova-compute[73012]:   <serial>d7306760-6967-4276-9e27-89ea1b0dabe1</serial>
Aug 14 12:08:49 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:08:49 user nova-compute[73012]: </disk>
Aug 14 12:08:49 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:08:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Successfully detached device vdb from instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 from the persistent domain config.
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:08:49 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:49 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:08:49 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:08:49 user nova-compute[73012]:   <serial>d7306760-6967-4276-9e27-89ea1b0dabe1</serial>
Aug 14 12:08:49 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:08:49 user nova-compute[73012]: </disk>
Aug 14 12:08:49 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:08:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692014930.1873991, ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:08:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Successfully detached device vdb from instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 from the live domain config.
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGDpsTBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'd7306760-6967-4276-9e27-89ea1b0dabe1'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:08:50 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Successfully updated port: bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "refresh_cache-29b69875-6f7d-47e1-b254-8f01e07fffa3" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquired lock "refresh_cache-29b69875-6f7d-47e1-b254-8f01e07fffa3" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-45e57d21-d27f-41f4-9b9f-d4ea54a74a46 req-517f5005-9950-4f32-8729-9bc1c1db349e service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received event network-changed-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-45e57d21-d27f-41f4-9b9f-d4ea54a74a46 req-517f5005-9950-4f32-8729-9bc1c1db349e service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Refreshing instance network info cache due to event network-changed-bf8b8d7b-697a-4565-9904-063b2e35241f. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-45e57d21-d27f-41f4-9b9f-d4ea54a74a46 req-517f5005-9950-4f32-8729-9bc1c1db349e service nova] Acquiring lock "refresh_cache-29b69875-6f7d-47e1-b254-8f01e07fffa3" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '23463333661366631', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463333661366631', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.301s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5883ab3f-ca63-48db-80bc-35eedb8be576]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1274032774',display_name='tempest-TestShelveInstance-server-1274032774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1274032774',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpvfnDao+SuLCMwRtL6cICXvUR1y5xlI3EH4m/HCXMmrxCVfeVnw3wZr2m9KhBLwd9siNn+DZrbvEClHq9XQvO7VWCT5H/PVyxJXoTl8JDpT4hI1H7VfVFKutGQiWgNJw==',key_name='tempest-TestShelveInstance-584983205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e44af87d2aa64185ad02ba16d7cfe6b4',ramdisk_id='',reservation_id='r-thm9qhfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestShelveInstance-588328482',owner_user_name='tempest-TestShelveInstance-588328482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:08:38Z,user_data=None,user_id='ab939cda27a1447088d51c94b161f4d3',uuid=dadd3d4a-74da-416f-935c-2b064ea2ec16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converting VIF {"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.objects.instance [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lazy-loading 'pci_devices' on Instance uuid dadd3d4a-74da-416f-935c-2b064ea2ec16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:08:50 user nova-compute[73012]:   <uuid>dadd3d4a-74da-416f-935c-2b064ea2ec16</uuid>
Aug 14 12:08:50 user nova-compute[73012]:   <name>instance-0000000b</name>
Aug 14 12:08:50 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:08:50 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:08:50 user nova-compute[73012]:   <metadata>
Aug 14 12:08:50 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:08:50 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:name>tempest-TestShelveInstance-server-1274032774</nova:name>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:08:48</nova:creationTime>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:08:50 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:08:50 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:owner>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:user uuid="ab939cda27a1447088d51c94b161f4d3">tempest-TestShelveInstance-588328482-project-member</nova:user>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:project uuid="e44af87d2aa64185ad02ba16d7cfe6b4">tempest-TestShelveInstance-588328482</nova:project>
Aug 14 12:08:50 user nova-compute[73012]:       </nova:owner>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:ports>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:port uuid="93451164-a21f-49aa-991b-a941f82c80ee">
Aug 14 12:08:50 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 12:08:50 user nova-compute[73012]:         </nova:port>
Aug 14 12:08:50 user nova-compute[73012]:       </nova:ports>
Aug 14 12:08:50 user nova-compute[73012]:     </nova:instance>
Aug 14 12:08:50 user nova-compute[73012]:   </metadata>
Aug 14 12:08:50 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:08:50 user nova-compute[73012]:     <system>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="serial">dadd3d4a-74da-416f-935c-2b064ea2ec16</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="uuid">dadd3d4a-74da-416f-935c-2b064ea2ec16</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:08:50 user nova-compute[73012]:     </system>
Aug 14 12:08:50 user nova-compute[73012]:   </sysinfo>
Aug 14 12:08:50 user nova-compute[73012]:   <os>
Aug 14 12:08:50 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:08:50 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:08:50 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:08:50 user nova-compute[73012]:   </os>
Aug 14 12:08:50 user nova-compute[73012]:   <features>
Aug 14 12:08:50 user nova-compute[73012]:     <acpi/>
Aug 14 12:08:50 user nova-compute[73012]:     <apic/>
Aug 14 12:08:50 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:08:50 user nova-compute[73012]:   </features>
Aug 14 12:08:50 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:08:50 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:08:50 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:08:50 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:08:50 user nova-compute[73012]:   </clock>
Aug 14 12:08:50 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:08:50 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:08:50 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:08:50 user nova-compute[73012]:   </cpu>
Aug 14 12:08:50 user nova-compute[73012]:   <devices>
Aug 14 12:08:50 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:08:50 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:08:50 user nova-compute[73012]:       <source dev="/dev/sdc"/>
Aug 14 12:08:50 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:08:50 user nova-compute[73012]:       <serial>ae658aa7-5072-4837-a2ba-a4221136e98b</serial>
Aug 14 12:08:50 user nova-compute[73012]:     </disk>
Aug 14 12:08:50 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:08:50 user nova-compute[73012]:       <mac address="fa:16:3e:84:b1:ad"/>
Aug 14 12:08:50 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:08:50 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:08:50 user nova-compute[73012]:       <target dev="tap93451164-a2"/>
Aug 14 12:08:50 user nova-compute[73012]:     </interface>
Aug 14 12:08:50 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:08:50 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/dadd3d4a-74da-416f-935c-2b064ea2ec16/console.log" append="off"/>
Aug 14 12:08:50 user nova-compute[73012]:     </serial>
Aug 14 12:08:50 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:08:50 user nova-compute[73012]:     <video>
Aug 14 12:08:50 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:08:50 user nova-compute[73012]:     </video>
Aug 14 12:08:50 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:08:50 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:08:50 user nova-compute[73012]:     </rng>
Aug 14 12:08:50 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:08:50 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:08:50 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:08:50 user nova-compute[73012]:     </memballoon>
Aug 14 12:08:50 user nova-compute[73012]:   </devices>
Aug 14 12:08:50 user nova-compute[73012]: </domain>
Aug 14 12:08:50 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1274032774',display_name='tempest-TestShelveInstance-server-1274032774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1274032774',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpvfnDao+SuLCMwRtL6cICXvUR1y5xlI3EH4m/HCXMmrxCVfeVnw3wZr2m9KhBLwd9siNn+DZrbvEClHq9XQvO7VWCT5H/PVyxJXoTl8JDpT4hI1H7VfVFKutGQiWgNJw==',key_name='tempest-TestShelveInstance-584983205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e44af87d2aa64185ad02ba16d7cfe6b4',ramdisk_id='',reservation_id='r-thm9qhfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestShelveInstance-588328482',owner_user_name='tempest-TestShelveInstance-588328482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:08:38Z,user_data=None,user_id='ab939cda27a1447088d51c94b161f4d3',uuid=dadd3d4a-74da-416f-935c-2b064ea2ec16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converting VIF {"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_vif [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e11b8-3f57-4998-b74d-5aea50ab046c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:08:50 user nova-compute[73012]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:08:50 user nova-compute[73012]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 (non-flash)
Aug 14 12:08:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad06c6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Updating instance_info_cache with network_info: [{"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93451164-a2, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93451164-a2, col_values=(('external_ids', {'iface-id': '93451164-a21f-49aa-991b-a941f82c80ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:b1:ad', 'vm-uuid': 'dadd3d4a-74da-416f-935c-2b064ea2ec16'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:50 user nova-compute[73012]: INFO os_vif [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2')
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c463c9d2-56ef-45a7-be04-25a7d7cf5d5d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Releasing lock "refresh_cache-29b69875-6f7d-47e1-b254-8f01e07fffa3" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Instance network_info: |[{"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-45e57d21-d27f-41f4-9b9f-d4ea54a74a46 req-517f5005-9950-4f32-8729-9bc1c1db349e service nova] Acquired lock "refresh_cache-29b69875-6f7d-47e1-b254-8f01e07fffa3" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-45e57d21-d27f-41f4-9b9f-d4ea54a74a46 req-517f5005-9950-4f32-8729-9bc1c1db349e service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Refreshing network info cache for port bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Start _get_guest_xml network_info=[{"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a5f3cd-d12d-473e-8ce7-f22e1d87ee40]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:08:50 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:08:50 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1323330538',display_name='tempest-VolumesAdminNegativeTest-server-1323330538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1323330538',id=12,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2210f703a6814803bcfb4266d264b0f5',ramdisk_id='',reservation_id='r-00t3aeyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-384894799',owner_user_name='tempest-VolumesAdminNegativeTest-384894799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:08:49Z,user_data=None,user_id='9442db73842a465493b2e020a0977cce',uuid=29b69875-6f7d-47e1-b254-8f01e07fffa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converting VIF {"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf8b8d7b-697a-4565-9904-063b2e35241f,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8b8d7b-69') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.objects.instance [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lazy-loading 'pci_devices' on Instance uuid 29b69875-6f7d-47e1-b254-8f01e07fffa3 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[342f0227-8e43-41f5-add1-237372ad4b3b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:08:50 user nova-compute[73012]:   <uuid>29b69875-6f7d-47e1-b254-8f01e07fffa3</uuid>
Aug 14 12:08:50 user nova-compute[73012]:   <name>instance-0000000c</name>
Aug 14 12:08:50 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:08:50 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:08:50 user nova-compute[73012]:   <metadata>
Aug 14 12:08:50 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:08:50 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1323330538</nova:name>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:08:50</nova:creationTime>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:08:50 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:08:50 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:owner>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:user uuid="9442db73842a465493b2e020a0977cce">tempest-VolumesAdminNegativeTest-384894799-project-member</nova:user>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:project uuid="2210f703a6814803bcfb4266d264b0f5">tempest-VolumesAdminNegativeTest-384894799</nova:project>
Aug 14 12:08:50 user nova-compute[73012]:       </nova:owner>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:08:50 user nova-compute[73012]:       <nova:ports>
Aug 14 12:08:50 user nova-compute[73012]:         <nova:port uuid="bf8b8d7b-697a-4565-9904-063b2e35241f">
Aug 14 12:08:50 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 12:08:50 user nova-compute[73012]:         </nova:port>
Aug 14 12:08:50 user nova-compute[73012]:       </nova:ports>
Aug 14 12:08:50 user nova-compute[73012]:     </nova:instance>
Aug 14 12:08:50 user nova-compute[73012]:   </metadata>
Aug 14 12:08:50 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:08:50 user nova-compute[73012]:     <system>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="serial">29b69875-6f7d-47e1-b254-8f01e07fffa3</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="uuid">29b69875-6f7d-47e1-b254-8f01e07fffa3</entry>
Aug 14 12:08:50 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:08:50 user nova-compute[73012]:     </system>
Aug 14 12:08:50 user nova-compute[73012]:   </sysinfo>
Aug 14 12:08:50 user nova-compute[73012]:   <os>
Aug 14 12:08:50 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:08:50 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:08:50 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:08:50 user nova-compute[73012]:   </os>
Aug 14 12:08:50 user nova-compute[73012]:   <features>
Aug 14 12:08:50 user nova-compute[73012]:     <acpi/>
Aug 14 12:08:50 user nova-compute[73012]:     <apic/>
Aug 14 12:08:50 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:08:50 user nova-compute[73012]:   </features>
Aug 14 12:08:50 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:08:50 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:08:50 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:08:50 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:08:50 user nova-compute[73012]:   </clock>
Aug 14 12:08:50 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:08:50 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:08:50 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:08:50 user nova-compute[73012]:   </cpu>
Aug 14 12:08:50 user nova-compute[73012]:   <devices>
Aug 14 12:08:50 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:08:50 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:08:50 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk"/>
Aug 14 12:08:50 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:08:50 user nova-compute[73012]:     </disk>
Aug 14 12:08:50 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:08:50 user nova-compute[73012]:       <mac address="fa:16:3e:58:ec:4b"/>
Aug 14 12:08:50 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:08:50 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:08:50 user nova-compute[73012]:       <target dev="tapbf8b8d7b-69"/>
Aug 14 12:08:50 user nova-compute[73012]:     </interface>
Aug 14 12:08:50 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:08:50 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/console.log" append="off"/>
Aug 14 12:08:50 user nova-compute[73012]:     </serial>
Aug 14 12:08:50 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:08:50 user nova-compute[73012]:     <video>
Aug 14 12:08:50 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:08:50 user nova-compute[73012]:     </video>
Aug 14 12:08:50 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:08:50 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:08:50 user nova-compute[73012]:     </rng>
Aug 14 12:08:50 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:08:50 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:08:50 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:08:50 user nova-compute[73012]:     </memballoon>
Aug 14 12:08:50 user nova-compute[73012]:   </devices>
Aug 14 12:08:50 user nova-compute[73012]: </domain>
Aug 14 12:08:50 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1323330538',display_name='tempest-VolumesAdminNegativeTest-server-1323330538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1323330538',id=12,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2210f703a6814803bcfb4266d264b0f5',ramdisk_id='',reservation_id='r-00t3aeyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-384894799',owner_user_name='tempest-VolumesAdminNegativeTest-384894799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:08:49Z,user_data=None,user_id='9442db73842a465493b2e020a0977cce',uuid=29b69875-6f7d-47e1-b254-8f01e07fffa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converting VIF {"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf8b8d7b-697a-4565-9904-063b2e35241f,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8b8d7b-69') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_vif [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf8b8d7b-697a-4565-9904-063b2e35241f,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8b8d7b-69') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf8b8d7b-69, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf8b8d7b-69, col_values=(('external_ids', {'iface-id': 'bf8b8d7b-697a-4565-9904-063b2e35241f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:ec:4b', 'vm-uuid': '29b69875-6f7d-47e1-b254-8f01e07fffa3'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] No VIF found with MAC fa:16:3e:84:b1:ad, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:50 user nova-compute[73012]: INFO os_vif [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf8b8d7b-697a-4565-9904-063b2e35241f,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8b8d7b-69')
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbc8106-5f2c-477e-b01e-d3897337f100]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9e4eba-f5fa-4a59-bd3c-3d5fcafb5588]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] No VIF found with MAC fa:16:3e:58:ec:4b, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d80d515-6247-40a9-b313-bf57d9968e7d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260]
Aug 14 12:08:50 user nova-compute[73012]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1, portal: 172.16.0.220,3260] successful.
Aug 14 12:08:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7306760-6967-4276-9e27-89ea1b0dabe1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fe6181-1b02-4c9a-aa4b-1e92815ad774]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] <== disconnect_volume: return (611ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:08:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG nova.network.neutron [req-45e57d21-d27f-41f4-9b9f-d4ea54a74a46 req-517f5005-9950-4f32-8729-9bc1c1db349e service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Updated VIF entry in instance network info cache for port bf8b8d7b-697a-4565-9904-063b2e35241f. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG nova.network.neutron [req-45e57d21-d27f-41f4-9b9f-d4ea54a74a46 req-517f5005-9950-4f32-8729-9bc1c1db349e service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Updating instance_info_cache with network_info: [{"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-45e57d21-d27f-41f4-9b9f-d4ea54a74a46 req-517f5005-9950-4f32-8729-9bc1c1db349e service nova] Releasing lock "refresh_cache-29b69875-6f7d-47e1-b254-8f01e07fffa3" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lazy-loading 'flavor' on Instance uuid ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e5cdb0d6-2559-4a3d-b65c-3498a4888a6b tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.959s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:08:51 user nova-compute[73012]: INFO nova.compute.claims [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Claim successful on node user
Aug 14 12:08:51 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:08:51 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:08:52 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:08:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG nova.policy [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d6c467aee6140bda719332345af7ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5064d145e48eab20dc7ee82bdf779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:08:52 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Creating image(s)
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "/opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "/opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "/opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.168s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk 1073741824" returned: 0 in 0.049s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.203s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:08:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Successfully created port: 705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Cannot resize image /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.objects.instance [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'migration_context' on Instance uuid 66fb72b1-30a9-4be2-b843-7d648fc66e16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Ensure instance console log exists: /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-bbf76b80-b086-4556-992d-4f0e491cc2e9 req-92b81025-e0be-4265-bf05-6ebc3558e5b0 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bbf76b80-b086-4556-992d-4f0e491cc2e9 req-92b81025-e0be-4265-bf05-6ebc3558e5b0 service nova] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bbf76b80-b086-4556-992d-4f0e491cc2e9 req-92b81025-e0be-4265-bf05-6ebc3558e5b0 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bbf76b80-b086-4556-992d-4f0e491cc2e9 req-92b81025-e0be-4265-bf05-6ebc3558e5b0 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-bbf76b80-b086-4556-992d-4f0e491cc2e9 req-92b81025-e0be-4265-bf05-6ebc3558e5b0 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] No waiting events found dispatching network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:53 user nova-compute[73012]: WARNING nova.compute.manager [req-bbf76b80-b086-4556-992d-4f0e491cc2e9 req-92b81025-e0be-4265-bf05-6ebc3558e5b0 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received unexpected event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee for instance with vm_state building and task_state spawning.
Aug 14 12:08:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-fe6544fb-1f43-49e0-8a24-63ae66c6eee2 req-48f8f05d-2332-44b9-badd-62403a4b7309 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received event network-vif-plugged-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fe6544fb-1f43-49e0-8a24-63ae66c6eee2 req-48f8f05d-2332-44b9-badd-62403a4b7309 service nova] Acquiring lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fe6544fb-1f43-49e0-8a24-63ae66c6eee2 req-48f8f05d-2332-44b9-badd-62403a4b7309 service nova] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fe6544fb-1f43-49e0-8a24-63ae66c6eee2 req-48f8f05d-2332-44b9-badd-62403a4b7309 service nova] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-fe6544fb-1f43-49e0-8a24-63ae66c6eee2 req-48f8f05d-2332-44b9-badd-62403a4b7309 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] No waiting events found dispatching network-vif-plugged-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:53 user nova-compute[73012]: WARNING nova.compute.manager [req-fe6544fb-1f43-49e0-8a24-63ae66c6eee2 req-48f8f05d-2332-44b9-badd-62403a4b7309 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received unexpected event network-vif-plugged-bf8b8d7b-697a-4565-9904-063b2e35241f for instance with vm_state building and task_state spawning.
Aug 14 12:08:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692014918.5898125, 76214f3b-ceb8-4443-b70e-1dc6e0a11217 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:08:53 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] VM Stopped (Lifecycle Event)
Aug 14 12:08:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b246e74a-adb7-48ac-ac0c-da06c2f18982 None None] [instance: 76214f3b-ceb8-4443-b70e-1dc6e0a11217] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Successfully updated port: 705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquired lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-a9ce7f64-e81a-41db-9eaa-4823101c1000 req-f7fd9fe7-b980-4d58-afe2-0bf6983814db service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received event network-changed-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-a9ce7f64-e81a-41db-9eaa-4823101c1000 req-f7fd9fe7-b980-4d58-afe2-0bf6983814db service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Refreshing instance network info cache due to event network-changed-705f8ea2-972b-4194-ba28-1a16d9742dc4. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a9ce7f64-e81a-41db-9eaa-4823101c1000 req-f7fd9fe7-b980-4d58-afe2-0bf6983814db service nova] Acquiring lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updating instance_info_cache with network_info: [{"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Releasing lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Instance network_info: |[{"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a9ce7f64-e81a-41db-9eaa-4823101c1000 req-f7fd9fe7-b980-4d58-afe2-0bf6983814db service nova] Acquired lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.network.neutron [req-a9ce7f64-e81a-41db-9eaa-4823101c1000 req-f7fd9fe7-b980-4d58-afe2-0bf6983814db service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Refreshing network info cache for port 705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Start _get_guest_xml network_info=[{"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:08:54 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:08:54 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:08:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1566329280',display_name='tempest-ServerActionsTestOtherA-server-1566329280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1566329280',id=13,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFloYN1ReWoKPyBlc0SLCyu4ynKhd4hHFwk9GiyUMnITdI9Vxx2/nsK5EMWhGjgXLC4h+Dyjic41yKG1TsZ9FF3dSkrQKzlOkDc47k70qj4dK+sgWipPTYpvmqVW5R9Xg==',key_name='tempest-keypair-1585640726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-006x45pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=66fb72b1-30a9-4be2-b843-7d648fc66e16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:31:ef,bridge_name='br-int',has_traffic_filtering=True,id=705f8ea2-972b-4194-ba28-1a16d9742dc4,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705f8ea2-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.objects.instance [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'pci_devices' on Instance uuid 66fb72b1-30a9-4be2-b843-7d648fc66e16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:08:55 user nova-compute[73012]:   <uuid>66fb72b1-30a9-4be2-b843-7d648fc66e16</uuid>
Aug 14 12:08:55 user nova-compute[73012]:   <name>instance-0000000d</name>
Aug 14 12:08:55 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:08:55 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:08:55 user nova-compute[73012]:   <metadata>
Aug 14 12:08:55 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:08:55 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:08:55 user nova-compute[73012]:       <nova:name>tempest-ServerActionsTestOtherA-server-1566329280</nova:name>
Aug 14 12:08:55 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:08:54</nova:creationTime>
Aug 14 12:08:55 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:08:55 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:08:55 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:08:55 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:08:55 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:08:55 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:08:55 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:08:55 user nova-compute[73012]:       <nova:owner>
Aug 14 12:08:55 user nova-compute[73012]:         <nova:user uuid="7d6c467aee6140bda719332345af7ec0">tempest-ServerActionsTestOtherA-975401032-project-member</nova:user>
Aug 14 12:08:55 user nova-compute[73012]:         <nova:project uuid="33d5064d145e48eab20dc7ee82bdf779">tempest-ServerActionsTestOtherA-975401032</nova:project>
Aug 14 12:08:55 user nova-compute[73012]:       </nova:owner>
Aug 14 12:08:55 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:08:55 user nova-compute[73012]:       <nova:ports>
Aug 14 12:08:55 user nova-compute[73012]:         <nova:port uuid="705f8ea2-972b-4194-ba28-1a16d9742dc4">
Aug 14 12:08:55 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 12:08:55 user nova-compute[73012]:         </nova:port>
Aug 14 12:08:55 user nova-compute[73012]:       </nova:ports>
Aug 14 12:08:55 user nova-compute[73012]:     </nova:instance>
Aug 14 12:08:55 user nova-compute[73012]:   </metadata>
Aug 14 12:08:55 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:08:55 user nova-compute[73012]:     <system>
Aug 14 12:08:55 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:08:55 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:08:55 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:08:55 user nova-compute[73012]:       <entry name="serial">66fb72b1-30a9-4be2-b843-7d648fc66e16</entry>
Aug 14 12:08:55 user nova-compute[73012]:       <entry name="uuid">66fb72b1-30a9-4be2-b843-7d648fc66e16</entry>
Aug 14 12:08:55 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:08:55 user nova-compute[73012]:     </system>
Aug 14 12:08:55 user nova-compute[73012]:   </sysinfo>
Aug 14 12:08:55 user nova-compute[73012]:   <os>
Aug 14 12:08:55 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:08:55 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:08:55 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:08:55 user nova-compute[73012]:   </os>
Aug 14 12:08:55 user nova-compute[73012]:   <features>
Aug 14 12:08:55 user nova-compute[73012]:     <acpi/>
Aug 14 12:08:55 user nova-compute[73012]:     <apic/>
Aug 14 12:08:55 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:08:55 user nova-compute[73012]:   </features>
Aug 14 12:08:55 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:08:55 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:08:55 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:08:55 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:08:55 user nova-compute[73012]:   </clock>
Aug 14 12:08:55 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:08:55 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:08:55 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:08:55 user nova-compute[73012]:   </cpu>
Aug 14 12:08:55 user nova-compute[73012]:   <devices>
Aug 14 12:08:55 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:08:55 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:08:55 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk"/>
Aug 14 12:08:55 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:08:55 user nova-compute[73012]:     </disk>
Aug 14 12:08:55 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:08:55 user nova-compute[73012]:       <mac address="fa:16:3e:e9:31:ef"/>
Aug 14 12:08:55 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:08:55 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:08:55 user nova-compute[73012]:       <target dev="tap705f8ea2-97"/>
Aug 14 12:08:55 user nova-compute[73012]:     </interface>
Aug 14 12:08:55 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:08:55 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/console.log" append="off"/>
Aug 14 12:08:55 user nova-compute[73012]:     </serial>
Aug 14 12:08:55 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:08:55 user nova-compute[73012]:     <video>
Aug 14 12:08:55 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:08:55 user nova-compute[73012]:     </video>
Aug 14 12:08:55 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:08:55 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:08:55 user nova-compute[73012]:     </rng>
Aug 14 12:08:55 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:08:55 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:08:55 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:08:55 user nova-compute[73012]:     </memballoon>
Aug 14 12:08:55 user nova-compute[73012]:   </devices>
Aug 14 12:08:55 user nova-compute[73012]: </domain>
Aug 14 12:08:55 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1566329280',display_name='tempest-ServerActionsTestOtherA-server-1566329280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1566329280',id=13,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFloYN1ReWoKPyBlc0SLCyu4ynKhd4hHFwk9GiyUMnITdI9Vxx2/nsK5EMWhGjgXLC4h+Dyjic41yKG1TsZ9FF3dSkrQKzlOkDc47k70qj4dK+sgWipPTYpvmqVW5R9Xg==',key_name='tempest-keypair-1585640726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-006x45pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=66fb72b1-30a9-4be2-b843-7d648fc66e16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:31:ef,bridge_name='br-int',has_traffic_filtering=True,id=705f8ea2-972b-4194-ba28-1a16d9742dc4,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705f8ea2-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG os_vif [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:31:ef,bridge_name='br-int',has_traffic_filtering=True,id=705f8ea2-972b-4194-ba28-1a16d9742dc4,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705f8ea2-97') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap705f8ea2-97, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap705f8ea2-97, col_values=(('external_ids', {'iface-id': '705f8ea2-972b-4194-ba28-1a16d9742dc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:31:ef', 'vm-uuid': '66fb72b1-30a9-4be2-b843-7d648fc66e16'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:55 user nova-compute[73012]: INFO os_vif [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:31:ef,bridge_name='br-int',has_traffic_filtering=True,id=705f8ea2-972b-4194-ba28-1a16d9742dc4,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705f8ea2-97')
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No VIF found with MAC fa:16:3e:e9:31:ef, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a14bf48-902b-43c6-9158-20930a3beeec req-447f4ab7-e907-4c60-bd7f-091740a1a363 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a14bf48-902b-43c6-9158-20930a3beeec req-447f4ab7-e907-4c60-bd7f-091740a1a363 service nova] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a14bf48-902b-43c6-9158-20930a3beeec req-447f4ab7-e907-4c60-bd7f-091740a1a363 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a14bf48-902b-43c6-9158-20930a3beeec req-447f4ab7-e907-4c60-bd7f-091740a1a363 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a14bf48-902b-43c6-9158-20930a3beeec req-447f4ab7-e907-4c60-bd7f-091740a1a363 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] No waiting events found dispatching network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:55 user nova-compute[73012]: WARNING nova.compute.manager [req-7a14bf48-902b-43c6-9158-20930a3beeec req-447f4ab7-e907-4c60-bd7f-091740a1a363 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received unexpected event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee for instance with vm_state building and task_state spawning.
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-a9ce7f64-e81a-41db-9eaa-4823101c1000 req-f7fd9fe7-b980-4d58-afe2-0bf6983814db service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updated VIF entry in instance network info cache for port 705f8ea2-972b-4194-ba28-1a16d9742dc4. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-a9ce7f64-e81a-41db-9eaa-4823101c1000 req-f7fd9fe7-b980-4d58-afe2-0bf6983814db service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updating instance_info_cache with network_info: [{"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a9ce7f64-e81a-41db-9eaa-4823101c1000 req-f7fd9fe7-b980-4d58-afe2-0bf6983814db service nova] Releasing lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-ba13a5df-5c01-4a00-9b42-7ad80b2390ee req-645191f4-8540-40fc-8433-39e97daba249 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received event network-vif-plugged-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ba13a5df-5c01-4a00-9b42-7ad80b2390ee req-645191f4-8540-40fc-8433-39e97daba249 service nova] Acquiring lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ba13a5df-5c01-4a00-9b42-7ad80b2390ee req-645191f4-8540-40fc-8433-39e97daba249 service nova] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ba13a5df-5c01-4a00-9b42-7ad80b2390ee req-645191f4-8540-40fc-8433-39e97daba249 service nova] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-ba13a5df-5c01-4a00-9b42-7ad80b2390ee req-645191f4-8540-40fc-8433-39e97daba249 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] No waiting events found dispatching network-vif-plugged-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:55 user nova-compute[73012]: WARNING nova.compute.manager [req-ba13a5df-5c01-4a00-9b42-7ad80b2390ee req-645191f4-8540-40fc-8433-39e97daba249 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received unexpected event network-vif-plugged-bf8b8d7b-697a-4565-9904-063b2e35241f for instance with vm_state building and task_state spawning.
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014935.7424657, dadd3d4a-74da-416f-935c-2b064ea2ec16 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] VM Resumed (Lifecycle Event)
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance spawned successfully.
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014935.7459934, dadd3d4a-74da-416f-935c-2b064ea2ec16 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] VM Started (Lifecycle Event)
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Instance spawned successfully.
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014935.779487, 29b69875-6f7d-47e1-b254-8f01e07fffa3 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] VM Resumed (Lifecycle Event)
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Took 6.96 seconds to spawn the instance on the hypervisor.
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:08:55 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014935.7844157, 29b69875-6f7d-47e1-b254-8f01e07fffa3 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:08:55 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] VM Started (Lifecycle Event)
Aug 14 12:08:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:08:56 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:08:56 user nova-compute[73012]: INFO nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Took 7.41 seconds to spawn the instance on the hypervisor.
Aug 14 12:08:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:56 user nova-compute[73012]: INFO nova.compute.manager [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Took 19.17 seconds to build instance.
Aug 14 12:08:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-67be0605-762e-4354-92c8-a5005c58d0bc tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.268s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:56 user nova-compute[73012]: INFO nova.compute.manager [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Took 8.19 seconds to build instance.
Aug 14 12:08:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4397f30e-888b-4cad-acb0-36b73ff10731 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.448s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-d545084b-c3ed-420b-bedf-01322f33f284 req-59acb42c-9734-46ec-bccb-1d15e31ef75c service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received event network-vif-plugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d545084b-c3ed-420b-bedf-01322f33f284 req-59acb42c-9734-46ec-bccb-1d15e31ef75c service nova] Acquiring lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d545084b-c3ed-420b-bedf-01322f33f284 req-59acb42c-9734-46ec-bccb-1d15e31ef75c service nova] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d545084b-c3ed-420b-bedf-01322f33f284 req-59acb42c-9734-46ec-bccb-1d15e31ef75c service nova] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-d545084b-c3ed-420b-bedf-01322f33f284 req-59acb42c-9734-46ec-bccb-1d15e31ef75c service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] No waiting events found dispatching network-vif-plugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:56 user nova-compute[73012]: WARNING nova.compute.manager [req-d545084b-c3ed-420b-bedf-01322f33f284 req-59acb42c-9734-46ec-bccb-1d15e31ef75c service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received unexpected event network-vif-plugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 for instance with vm_state building and task_state spawning.
Aug 14 12:08:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:08:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-299b7e86-f5b6-4cdf-afb4-08d1a2a2c6e9 req-785b9fe3-d1e8-4d34-9a05-8881dcb0377d service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received event network-vif-plugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:08:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-299b7e86-f5b6-4cdf-afb4-08d1a2a2c6e9 req-785b9fe3-d1e8-4d34-9a05-8881dcb0377d service nova] Acquiring lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:08:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-299b7e86-f5b6-4cdf-afb4-08d1a2a2c6e9 req-785b9fe3-d1e8-4d34-9a05-8881dcb0377d service nova] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:08:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-299b7e86-f5b6-4cdf-afb4-08d1a2a2c6e9 req-785b9fe3-d1e8-4d34-9a05-8881dcb0377d service nova] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-299b7e86-f5b6-4cdf-afb4-08d1a2a2c6e9 req-785b9fe3-d1e8-4d34-9a05-8881dcb0377d service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] No waiting events found dispatching network-vif-plugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:08:58 user nova-compute[73012]: WARNING nova.compute.manager [req-299b7e86-f5b6-4cdf-afb4-08d1a2a2c6e9 req-785b9fe3-d1e8-4d34-9a05-8881dcb0377d service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received unexpected event network-vif-plugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 for instance with vm_state building and task_state spawning.
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014939.4091983, 66fb72b1-30a9-4be2-b843-7d648fc66e16 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:08:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] VM Resumed (Lifecycle Event)
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:08:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Instance spawned successfully.
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:08:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014939.4131298, 66fb72b1-30a9-4be2-b843-7d648fc66e16 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:08:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] VM Started (Lifecycle Event)
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:08:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:08:59 user nova-compute[73012]: INFO nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Took 7.27 seconds to spawn the instance on the hypervisor.
Aug 14 12:08:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:08:59 user nova-compute[73012]: INFO nova.compute.manager [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Took 8.05 seconds to build instance.
Aug 14 12:08:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84d06f10-844c-4e68-b944-fe8369019121 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.149s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:08:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:05 user nova-compute[73012]: INFO nova.compute.manager [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Terminating instance
Aug 14 12:09:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-204b4f52-dca9-49a8-ba26-0db0db22abc5 req-62aa647d-b258-4118-82cb-0e0f5d637f8f service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received event network-vif-unplugged-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-204b4f52-dca9-49a8-ba26-0db0db22abc5 req-62aa647d-b258-4118-82cb-0e0f5d637f8f service nova] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-204b4f52-dca9-49a8-ba26-0db0db22abc5 req-62aa647d-b258-4118-82cb-0e0f5d637f8f service nova] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-204b4f52-dca9-49a8-ba26-0db0db22abc5 req-62aa647d-b258-4118-82cb-0e0f5d637f8f service nova] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-204b4f52-dca9-49a8-ba26-0db0db22abc5 req-62aa647d-b258-4118-82cb-0e0f5d637f8f service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] No waiting events found dispatching network-vif-unplugged-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-204b4f52-dca9-49a8-ba26-0db0db22abc5 req-62aa647d-b258-4118-82cb-0e0f5d637f8f service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received event network-vif-unplugged-04bdd88d-db33-48f1-8154-b4fec28a16cf for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Instance destroyed successfully.
Aug 14 12:09:06 user nova-compute[73012]: DEBUG nova.objects.instance [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lazy-loading 'resources' on Instance uuid e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1659614832',display_name='tempest-VolumesAssistedSnapshotsTest-server-1659614832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1659614832',id=6,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCls6nW3QlKre9ktWyCj8bewjrRrWyuGhtewhjlSWYbuaGyEWmJadvZLBGaF6EfktM0mqir/aYl7MGSs5wESGIBWQ1Xp9URlDUgWCyl9WyEkJB1R2+Av3aNO/Dox+RpPfw==',key_name='tempest-keypair-126397586',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3747825102fc4c2bb39eccf5ead6e113',ramdisk_id='',reservation_id='r-mi3ge7ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-154964725',owner_user_name='tempest-VolumesAssistedSnapshotsTest-154964725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693ca10f33fd4efba6ea8b4b8f3aacf0',uuid=e67d6abc-b9b5-4c6d-83e0-1e064928dfd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Converting VIF {"id": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "address": "fa:16:3e:1b:4d:05", "network": {"id": "eb9529e6-f99b-4b8b-bb36-73e95db30277", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2138740927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3747825102fc4c2bb39eccf5ead6e113", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bdd88d-db", "ovs_interfaceid": "04bdd88d-db33-48f1-8154-b4fec28a16cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=04bdd88d-db33-48f1-8154-b4fec28a16cf,network=Network(eb9529e6-f99b-4b8b-bb36-73e95db30277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bdd88d-db') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG os_vif [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=04bdd88d-db33-48f1-8154-b4fec28a16cf,network=Network(eb9529e6-f99b-4b8b-bb36-73e95db30277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bdd88d-db') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04bdd88d-db, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:09:06 user nova-compute[73012]: INFO os_vif [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=04bdd88d-db33-48f1-8154-b4fec28a16cf,network=Network(eb9529e6-f99b-4b8b-bb36-73e95db30277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bdd88d-db')
Aug 14 12:09:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Deleting instance files /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7_del
Aug 14 12:09:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Deletion of /opt/stack/data/nova/instances/e67d6abc-b9b5-4c6d-83e0-1e064928dfd7_del complete
Aug 14 12:09:06 user nova-compute[73012]: INFO nova.compute.manager [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 12:09:06 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:09:06 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:09:07 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:07 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Took 0.95 seconds to deallocate network for instance.
Aug 14 12:09:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-c485127a-93db-4528-8c01-a10dee1e274a req-b48cb924-9845-48fd-9211-48f29f38bc84 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received event network-vif-deleted-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:08 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Deleted allocations for instance e67d6abc-b9b5-4c6d-83e0-1e064928dfd7
Aug 14 12:09:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-94e637be-4f77-4ac5-8618-dd461b0eab60 req-e367dad5-6a92-418e-8da8-40f7c93cd263 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received event network-vif-plugged-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94e637be-4f77-4ac5-8618-dd461b0eab60 req-e367dad5-6a92-418e-8da8-40f7c93cd263 service nova] Acquiring lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94e637be-4f77-4ac5-8618-dd461b0eab60 req-e367dad5-6a92-418e-8da8-40f7c93cd263 service nova] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94e637be-4f77-4ac5-8618-dd461b0eab60 req-e367dad5-6a92-418e-8da8-40f7c93cd263 service nova] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-94e637be-4f77-4ac5-8618-dd461b0eab60 req-e367dad5-6a92-418e-8da8-40f7c93cd263 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] No waiting events found dispatching network-vif-plugged-04bdd88d-db33-48f1-8154-b4fec28a16cf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:08 user nova-compute[73012]: WARNING nova.compute.manager [req-94e637be-4f77-4ac5-8618-dd461b0eab60 req-e367dad5-6a92-418e-8da8-40f7c93cd263 service nova] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Received unexpected event network-vif-plugged-04bdd88d-db33-48f1-8154-b4fec28a16cf for instance with vm_state deleted and task_state None.
Aug 14 12:09:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-44c4ced1-9aa7-4bf8-b3e3-d0d397fab203 tempest-VolumesAssistedSnapshotsTest-154964725 tempest-VolumesAssistedSnapshotsTest-154964725-project-member] Lock "e67d6abc-b9b5-4c6d-83e0-1e064928dfd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.494s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:08 user nova-compute[73012]: INFO nova.compute.manager [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Terminating instance
Aug 14 12:09:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-8df49ebd-7774-4ef8-b0ff-f5e314a8c39d req-199ac211-c4e8-4594-9b03-fe4a99629866 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-unplugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8df49ebd-7774-4ef8-b0ff-f5e314a8c39d req-199ac211-c4e8-4594-9b03-fe4a99629866 service nova] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8df49ebd-7774-4ef8-b0ff-f5e314a8c39d req-199ac211-c4e8-4594-9b03-fe4a99629866 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8df49ebd-7774-4ef8-b0ff-f5e314a8c39d req-199ac211-c4e8-4594-9b03-fe4a99629866 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-8df49ebd-7774-4ef8-b0ff-f5e314a8c39d req-199ac211-c4e8-4594-9b03-fe4a99629866 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] No waiting events found dispatching network-vif-unplugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-8df49ebd-7774-4ef8-b0ff-f5e314a8c39d req-199ac211-c4e8-4594-9b03-fe4a99629866 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-unplugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:09 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Instance destroyed successfully.
Aug 14 12:09:09 user nova-compute[73012]: DEBUG nova.objects.instance [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lazy-loading 'resources' on Instance uuid 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:06:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-517741125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-517741125',id=8,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2TTpmfaQPgY9ohNbVadAHJOLiNi1lPNazCQ0/vgYaopsQex8HgTVtrzr1PsGl+iZ8XzkXNAGaX1YvJAn1t8iAMrG6pCLvmKBNfbkLxAoKRO+zDopEQxka9+HZl/6dPMQ==',key_name='tempest-keypair-779145758',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a60f4140fa9e464ba556f644132aad96',ramdisk_id='',reservation_id='r-7nj3lvpu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1305129888',owner_user_name='tempest-TaggedAttachmentsTest-1305129888-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd40979075344b28d0223d4b5084508',uuid=96b9a98d-d416-40ef-aa85-ce23ad77e9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converting VIF {"id": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "address": "fa:16:3e:a2:ae:c8", "network": {"id": "afb0b1b7-00d0-4088-a3d4-2b0a7323d79f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1579606553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a60f4140fa9e464ba556f644132aad96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30ec13f3-55", "ovs_interfaceid": "30ec13f3-55af-4216-a06e-63bc7b1fb9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=30ec13f3-55af-4216-a06e-63bc7b1fb9b6,network=Network(afb0b1b7-00d0-4088-a3d4-2b0a7323d79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30ec13f3-55') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG os_vif [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=30ec13f3-55af-4216-a06e-63bc7b1fb9b6,network=Network(afb0b1b7-00d0-4088-a3d4-2b0a7323d79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30ec13f3-55') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30ec13f3-55, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:09:09 user nova-compute[73012]: INFO os_vif [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=30ec13f3-55af-4216-a06e-63bc7b1fb9b6,network=Network(afb0b1b7-00d0-4088-a3d4-2b0a7323d79f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30ec13f3-55')
Aug 14 12:09:09 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Deleting instance files /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7_del
Aug 14 12:09:09 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Deletion of /opt/stack/data/nova/instances/96b9a98d-d416-40ef-aa85-ce23ad77e9d7_del complete
Aug 14 12:09:09 user nova-compute[73012]: INFO nova.compute.manager [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 12:09:09 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:09:09 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:09:10 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-e81d43a5-88dd-43da-92b1-478b5e023308 req-f42c2af7-bc19-4945-991b-a04ad955ce57 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-deleted-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:10 user nova-compute[73012]: INFO nova.compute.manager [req-e81d43a5-88dd-43da-92b1-478b5e023308 req-f42c2af7-bc19-4945-991b-a04ad955ce57 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Neutron deleted interface 30ec13f3-55af-4216-a06e-63bc7b1fb9b6; detaching it from the instance and deleting it from the info cache
Aug 14 12:09:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-e81d43a5-88dd-43da-92b1-478b5e023308 req-f42c2af7-bc19-4945-991b-a04ad955ce57 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:10 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Took 1.33 seconds to deallocate network for instance.
Aug 14 12:09:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-e81d43a5-88dd-43da-92b1-478b5e023308 req-f42c2af7-bc19-4945-991b-a04ad955ce57 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Detach interface failed, port_id=30ec13f3-55af-4216-a06e-63bc7b1fb9b6, reason: Instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:09:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-06984f3c-70a2-4c73-8bab-165981b09251 req-cb4cecb7-015e-40d1-8a0e-76a582d9e6b9 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received event network-vif-plugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-06984f3c-70a2-4c73-8bab-165981b09251 req-cb4cecb7-015e-40d1-8a0e-76a582d9e6b9 service nova] Acquiring lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-06984f3c-70a2-4c73-8bab-165981b09251 req-cb4cecb7-015e-40d1-8a0e-76a582d9e6b9 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-06984f3c-70a2-4c73-8bab-165981b09251 req-cb4cecb7-015e-40d1-8a0e-76a582d9e6b9 service nova] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-06984f3c-70a2-4c73-8bab-165981b09251 req-cb4cecb7-015e-40d1-8a0e-76a582d9e6b9 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] No waiting events found dispatching network-vif-plugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:11 user nova-compute[73012]: WARNING nova.compute.manager [req-06984f3c-70a2-4c73-8bab-165981b09251 req-cb4cecb7-015e-40d1-8a0e-76a582d9e6b9 service nova] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Received unexpected event network-vif-plugged-30ec13f3-55af-4216-a06e-63bc7b1fb9b6 for instance with vm_state deleted and task_state None.
Aug 14 12:09:11 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:09:11 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:09:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.857s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:11 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Deleted allocations for instance 96b9a98d-d416-40ef-aa85-ce23ad77e9d7
Aug 14 12:09:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19f08671-b9f4-4645-b6ea-668042d1aa5f tempest-TaggedAttachmentsTest-1305129888 tempest-TaggedAttachmentsTest-1305129888-project-member] Lock "96b9a98d-d416-40ef-aa85-ce23ad77e9d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.501s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:18 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'flavor' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:19 user nova-compute[73012]: INFO nova.compute.manager [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Attaching volume 788e399a-6264-44c5-95ed-b689ede0f853 to /dev/vdb
Aug 14 12:09:19 user nova-compute[73012]: DEBUG os_brick.utils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20d3172-bea3-438b-b1e2-658fd6ab8ad5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[118b47eb-f29d-4f40-812e-8556d5f1599f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c102d758-4e99-46d0-a49b-2d04715ee084]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dd6659-580d-479e-97f1-598b24a6db25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:09:19 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4de971-6d30-4ead-9bb0-063251780f55]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG os_brick.utils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating existing volume attachment record: f8d43797-0afb-4849-b48d-796c60bdd299 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:19 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:09:19 user nova-compute[73012]: INFO nova.compute.claims [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Claim successful on node user
Aug 14 12:09:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:09:20 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.policy [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7128922092841c49b475af30075e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac2852176e4d7580080e2320371fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:09:20 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Creating image(s)
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:09:20 user nova-compute[73012]: INFO nova.compute.claims [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Claim successful on node user
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.235s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk 1073741824" returned: 0 in 0.057s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Successfully created port: 8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Cannot resize image /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'migration_context' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Ensure instance console log exists: /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.network.neutron [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:09:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.policy [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7128922092841c49b475af30075e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac2852176e4d7580080e2320371fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:09:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Creating image(s)
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692014946.5736663, e67d6abc-b9b5-4c6d-83e0-1e064928dfd7 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:21 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] VM Stopped (Lifecycle Event)
Aug 14 12:09:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-5c83a738-217a-4527-b654-807403c4f538 None None] [instance: e67d6abc-b9b5-4c6d-83e0-1e064928dfd7] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.202s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk 1073741824" returned: 0 in 0.069s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Successfully created port: 8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:22 user nova-compute[73012]: INFO nova.compute.manager [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Unshelving
Aug 14 12:09:22 user nova-compute[73012]: INFO nova.virt.block_device [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Booting with volume 5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 at /dev/vdc
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Successfully updated port: 8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquired lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-d8df35ff-13f8-4741-b3df-30b7542c3ec1 req-6dd0ac93-5259-47e6-9d47-06a06a514358 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-changed-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-d8df35ff-13f8-4741-b3df-30b7542c3ec1 req-6dd0ac93-5259-47e6-9d47-06a06a514358 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Refreshing instance network info cache due to event network-changed-8935f630-5b68-43e3-a48c-ae0f19b19368. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d8df35ff-13f8-4741-b3df-30b7542c3ec1 req-6dd0ac93-5259-47e6-9d47-06a06a514358 service nova] Acquiring lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG os_brick.utils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e67f9-860c-4049-8a9d-2dafde59279e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b301177-89ca-4e4c-aac8-c2e6cd616587]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b16b15-548f-49f4-8b39-acbf0f2f8fbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e3d6ee-6440-4786-94c0-fcc685c81f16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Cannot resize image /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.objects.instance [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'migration_context' on Instance uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:09:22 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[80008d0f-e14f-43b6-9abf-657f70c11a81]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG os_brick.utils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating existing volume attachment record: ea2535ff-e5ca-4946-9b70-4bbb4b71b941 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Ensure instance console log exists: /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Successfully updated port: 8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquired lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-2bf1fb40-6d04-419d-97f5-1367fe448968 req-024e6576-e3d3-49bd-a21a-35290b954d2d service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-changed-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-2bf1fb40-6d04-419d-97f5-1367fe448968 req-024e6576-e3d3-49bd-a21a-35290b954d2d service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Refreshing instance network info cache due to event network-changed-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2bf1fb40-6d04-419d-97f5-1367fe448968 req-024e6576-e3d3-49bd-a21a-35290b954d2d service nova] Acquiring lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updating instance_info_cache with network_info: [{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Releasing lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Instance network_info: |[{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d8df35ff-13f8-4741-b3df-30b7542c3ec1 req-6dd0ac93-5259-47e6-9d47-06a06a514358 service nova] Acquired lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.neutron [req-d8df35ff-13f8-4741-b3df-30b7542c3ec1 req-6dd0ac93-5259-47e6-9d47-06a06a514358 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Refreshing network info cache for port 8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Start _get_guest_xml network_info=[{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:09:22 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:22 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-852374389',display_name='tempest-ServerRescueNegativeTestJSON-server-852374389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-852374389',id=14,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-raidpx0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:20Z,user_data=None,user_id='e7128922092841c49b475af30075e458',uuid=c2247c01-f5c8-42f3-9f16-231e7198d4e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:12:3c,bridge_name='br-int',has_traffic_filtering=True,id=8935f630-5b68-43e3-a48c-ae0f19b19368,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8935f630-5b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'pci_devices' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:09:22 user nova-compute[73012]:   <uuid>c2247c01-f5c8-42f3-9f16-231e7198d4e8</uuid>
Aug 14 12:09:22 user nova-compute[73012]:   <name>instance-0000000e</name>
Aug 14 12:09:22 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:09:22 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:09:22 user nova-compute[73012]:   <metadata>
Aug 14 12:09:22 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:09:22 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:09:22 user nova-compute[73012]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-852374389</nova:name>
Aug 14 12:09:22 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:09:22</nova:creationTime>
Aug 14 12:09:22 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:09:22 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:09:22 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:09:22 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:09:22 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:09:22 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:09:22 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:09:22 user nova-compute[73012]:       <nova:owner>
Aug 14 12:09:22 user nova-compute[73012]:         <nova:user uuid="e7128922092841c49b475af30075e458">tempest-ServerRescueNegativeTestJSON-334705254-project-member</nova:user>
Aug 14 12:09:22 user nova-compute[73012]:         <nova:project uuid="96ac2852176e4d7580080e2320371fe8">tempest-ServerRescueNegativeTestJSON-334705254</nova:project>
Aug 14 12:09:22 user nova-compute[73012]:       </nova:owner>
Aug 14 12:09:22 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:09:22 user nova-compute[73012]:       <nova:ports>
Aug 14 12:09:22 user nova-compute[73012]:         <nova:port uuid="8935f630-5b68-43e3-a48c-ae0f19b19368">
Aug 14 12:09:22 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 12:09:22 user nova-compute[73012]:         </nova:port>
Aug 14 12:09:22 user nova-compute[73012]:       </nova:ports>
Aug 14 12:09:22 user nova-compute[73012]:     </nova:instance>
Aug 14 12:09:22 user nova-compute[73012]:   </metadata>
Aug 14 12:09:22 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:09:22 user nova-compute[73012]:     <system>
Aug 14 12:09:22 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:09:22 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:09:22 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:09:22 user nova-compute[73012]:       <entry name="serial">c2247c01-f5c8-42f3-9f16-231e7198d4e8</entry>
Aug 14 12:09:22 user nova-compute[73012]:       <entry name="uuid">c2247c01-f5c8-42f3-9f16-231e7198d4e8</entry>
Aug 14 12:09:22 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:09:22 user nova-compute[73012]:     </system>
Aug 14 12:09:22 user nova-compute[73012]:   </sysinfo>
Aug 14 12:09:22 user nova-compute[73012]:   <os>
Aug 14 12:09:22 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:09:22 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:09:22 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:09:22 user nova-compute[73012]:   </os>
Aug 14 12:09:22 user nova-compute[73012]:   <features>
Aug 14 12:09:22 user nova-compute[73012]:     <acpi/>
Aug 14 12:09:22 user nova-compute[73012]:     <apic/>
Aug 14 12:09:22 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:09:22 user nova-compute[73012]:   </features>
Aug 14 12:09:22 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:09:22 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:09:22 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:09:22 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:09:22 user nova-compute[73012]:   </clock>
Aug 14 12:09:22 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:09:22 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:09:22 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:09:22 user nova-compute[73012]:   </cpu>
Aug 14 12:09:22 user nova-compute[73012]:   <devices>
Aug 14 12:09:22 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:09:22 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:09:22 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk"/>
Aug 14 12:09:22 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:09:22 user nova-compute[73012]:     </disk>
Aug 14 12:09:22 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:09:22 user nova-compute[73012]:       <mac address="fa:16:3e:9e:12:3c"/>
Aug 14 12:09:22 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:22 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:09:22 user nova-compute[73012]:       <target dev="tap8935f630-5b"/>
Aug 14 12:09:22 user nova-compute[73012]:     </interface>
Aug 14 12:09:22 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:09:22 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/console.log" append="off"/>
Aug 14 12:09:22 user nova-compute[73012]:     </serial>
Aug 14 12:09:22 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:09:22 user nova-compute[73012]:     <video>
Aug 14 12:09:22 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:22 user nova-compute[73012]:     </video>
Aug 14 12:09:22 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:09:22 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:09:22 user nova-compute[73012]:     </rng>
Aug 14 12:09:22 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:09:22 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:09:22 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:09:22 user nova-compute[73012]:     </memballoon>
Aug 14 12:09:22 user nova-compute[73012]:   </devices>
Aug 14 12:09:22 user nova-compute[73012]: </domain>
Aug 14 12:09:22 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-852374389',display_name='tempest-ServerRescueNegativeTestJSON-server-852374389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-852374389',id=14,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-raidpx0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:20Z,user_data=None,user_id='e7128922092841c49b475af30075e458',uuid=c2247c01-f5c8-42f3-9f16-231e7198d4e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:12:3c,bridge_name='br-int',has_traffic_filtering=True,id=8935f630-5b68-43e3-a48c-ae0f19b19368,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8935f630-5b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG os_vif [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:12:3c,bridge_name='br-int',has_traffic_filtering=True,id=8935f630-5b68-43e3-a48c-ae0f19b19368,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8935f630-5b') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8935f630-5b, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8935f630-5b, col_values=(('external_ids', {'iface-id': '8935f630-5b68-43e3-a48c-ae0f19b19368', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:12:3c', 'vm-uuid': 'c2247c01-f5c8-42f3-9f16-231e7198d4e8'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:09:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:22 user nova-compute[73012]: INFO os_vif [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:12:3c,bridge_name='br-int',has_traffic_filtering=True,id=8935f630-5b68-43e3-a48c-ae0f19b19368,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8935f630-5b')
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No VIF found with MAC fa:16:3e:9e:12:3c, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.neutron [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Updating instance_info_cache with network_info: [{"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Releasing lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Instance network_info: |[{"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2bf1fb40-6d04-419d-97f5-1367fe448968 req-024e6576-e3d3-49bd-a21a-35290b954d2d service nova] Acquired lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.neutron [req-2bf1fb40-6d04-419d-97f5-1367fe448968 req-024e6576-e3d3-49bd-a21a-35290b954d2d service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Refreshing network info cache for port 8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Start _get_guest_xml network_info=[{"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:09:23 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:23 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1536270',display_name='tempest-ServerRescueNegativeTestJSON-server-1536270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1536270',id=15,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-6d0napzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:21Z,user_data=None,user_id='e7128922092841c49b475af30075e458',uuid=ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fd:85,bridge_name='br-int',has_traffic_filtering=True,id=8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5e5b4d-d3') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.objects.instance [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'pci_devices' on Instance uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:09:23 user nova-compute[73012]:   <uuid>ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e</uuid>
Aug 14 12:09:23 user nova-compute[73012]:   <name>instance-0000000f</name>
Aug 14 12:09:23 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:09:23 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:09:23 user nova-compute[73012]:   <metadata>
Aug 14 12:09:23 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:09:23 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:09:23 user nova-compute[73012]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1536270</nova:name>
Aug 14 12:09:23 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:09:23</nova:creationTime>
Aug 14 12:09:23 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:09:23 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:09:23 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:09:23 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:09:23 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:09:23 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:09:23 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:09:23 user nova-compute[73012]:       <nova:owner>
Aug 14 12:09:23 user nova-compute[73012]:         <nova:user uuid="e7128922092841c49b475af30075e458">tempest-ServerRescueNegativeTestJSON-334705254-project-member</nova:user>
Aug 14 12:09:23 user nova-compute[73012]:         <nova:project uuid="96ac2852176e4d7580080e2320371fe8">tempest-ServerRescueNegativeTestJSON-334705254</nova:project>
Aug 14 12:09:23 user nova-compute[73012]:       </nova:owner>
Aug 14 12:09:23 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:09:23 user nova-compute[73012]:       <nova:ports>
Aug 14 12:09:23 user nova-compute[73012]:         <nova:port uuid="8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a">
Aug 14 12:09:23 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 12:09:23 user nova-compute[73012]:         </nova:port>
Aug 14 12:09:23 user nova-compute[73012]:       </nova:ports>
Aug 14 12:09:23 user nova-compute[73012]:     </nova:instance>
Aug 14 12:09:23 user nova-compute[73012]:   </metadata>
Aug 14 12:09:23 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:09:23 user nova-compute[73012]:     <system>
Aug 14 12:09:23 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:09:23 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:09:23 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:09:23 user nova-compute[73012]:       <entry name="serial">ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e</entry>
Aug 14 12:09:23 user nova-compute[73012]:       <entry name="uuid">ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e</entry>
Aug 14 12:09:23 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:09:23 user nova-compute[73012]:     </system>
Aug 14 12:09:23 user nova-compute[73012]:   </sysinfo>
Aug 14 12:09:23 user nova-compute[73012]:   <os>
Aug 14 12:09:23 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:09:23 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:09:23 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:09:23 user nova-compute[73012]:   </os>
Aug 14 12:09:23 user nova-compute[73012]:   <features>
Aug 14 12:09:23 user nova-compute[73012]:     <acpi/>
Aug 14 12:09:23 user nova-compute[73012]:     <apic/>
Aug 14 12:09:23 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:09:23 user nova-compute[73012]:   </features>
Aug 14 12:09:23 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:09:23 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:09:23 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:09:23 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:09:23 user nova-compute[73012]:   </clock>
Aug 14 12:09:23 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:09:23 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:09:23 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:09:23 user nova-compute[73012]:   </cpu>
Aug 14 12:09:23 user nova-compute[73012]:   <devices>
Aug 14 12:09:23 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:09:23 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:09:23 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk"/>
Aug 14 12:09:23 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:09:23 user nova-compute[73012]:     </disk>
Aug 14 12:09:23 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:09:23 user nova-compute[73012]:       <mac address="fa:16:3e:e6:fd:85"/>
Aug 14 12:09:23 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:23 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:09:23 user nova-compute[73012]:       <target dev="tap8e5e5b4d-d3"/>
Aug 14 12:09:23 user nova-compute[73012]:     </interface>
Aug 14 12:09:23 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:09:23 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/console.log" append="off"/>
Aug 14 12:09:23 user nova-compute[73012]:     </serial>
Aug 14 12:09:23 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:09:23 user nova-compute[73012]:     <video>
Aug 14 12:09:23 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:23 user nova-compute[73012]:     </video>
Aug 14 12:09:23 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:09:23 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:09:23 user nova-compute[73012]:     </rng>
Aug 14 12:09:23 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:09:23 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:09:23 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:09:23 user nova-compute[73012]:     </memballoon>
Aug 14 12:09:23 user nova-compute[73012]:   </devices>
Aug 14 12:09:23 user nova-compute[73012]: </domain>
Aug 14 12:09:23 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1536270',display_name='tempest-ServerRescueNegativeTestJSON-server-1536270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1536270',id=15,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-6d0napzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:21Z,user_data=None,user_id='e7128922092841c49b475af30075e458',uuid=ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fd:85,bridge_name='br-int',has_traffic_filtering=True,id=8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5e5b4d-d3') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG os_vif [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fd:85,bridge_name='br-int',has_traffic_filtering=True,id=8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5e5b4d-d3') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e5e5b4d-d3, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e5e5b4d-d3, col_values=(('external_ids', {'iface-id': '8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:fd:85', 'vm-uuid': 'ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:23 user nova-compute[73012]: INFO os_vif [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:fd:85,bridge_name='br-int',has_traffic_filtering=True,id=8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5e5b4d-d3')
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No VIF found with MAC fa:16:3e:e6:fd:85, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.neutron [req-d8df35ff-13f8-4741-b3df-30b7542c3ec1 req-6dd0ac93-5259-47e6-9d47-06a06a514358 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updated VIF entry in instance network info cache for port 8935f630-5b68-43e3-a48c-ae0f19b19368. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.neutron [req-d8df35ff-13f8-4741-b3df-30b7542c3ec1 req-6dd0ac93-5259-47e6-9d47-06a06a514358 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updating instance_info_cache with network_info: [{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d8df35ff-13f8-4741-b3df-30b7542c3ec1 req-6dd0ac93-5259-47e6-9d47-06a06a514358 service nova] Releasing lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.neutron [req-2bf1fb40-6d04-419d-97f5-1367fe448968 req-024e6576-e3d3-49bd-a21a-35290b954d2d service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Updated VIF entry in instance network info cache for port 8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG nova.network.neutron [req-2bf1fb40-6d04-419d-97f5-1367fe448968 req-024e6576-e3d3-49bd-a21a-35290b954d2d service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Updating instance_info_cache with network_info: [{"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2bf1fb40-6d04-419d-97f5-1367fe448968 req-024e6576-e3d3-49bd-a21a-35290b954d2d service nova] Releasing lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:24 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692014949.4628434, 96b9a98d-d416-40ef-aa85-ce23ad77e9d7 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:24 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] VM Stopped (Lifecycle Event)
Aug 14 12:09:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4947e56d-20bd-489f-a05b-74fd6c8a098f None None] [instance: 96b9a98d-d416-40ef-aa85-ce23ad77e9d7] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-c96f1d2e-e767-4512-b246-3c34d9367413 req-3cd75399-6dd0-457d-a550-17ea335f9032 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c96f1d2e-e767-4512-b246-3c34d9367413 req-3cd75399-6dd0-457d-a550-17ea335f9032 service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c96f1d2e-e767-4512-b246-3c34d9367413 req-3cd75399-6dd0-457d-a550-17ea335f9032 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c96f1d2e-e767-4512-b246-3c34d9367413 req-3cd75399-6dd0-457d-a550-17ea335f9032 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-c96f1d2e-e767-4512-b246-3c34d9367413 req-3cd75399-6dd0-457d-a550-17ea335f9032 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:25 user nova-compute[73012]: WARNING nova.compute.manager [req-c96f1d2e-e767-4512-b246-3c34d9367413 req-3cd75399-6dd0-457d-a550-17ea335f9032 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state building and task_state spawning.
Aug 14 12:09:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-f0a44e1b-45d5-48a6-8168-2095db71189a req-b5bc44fc-b109-4971-a7cf-177156f55570 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f0a44e1b-45d5-48a6-8168-2095db71189a req-b5bc44fc-b109-4971-a7cf-177156f55570 service nova] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f0a44e1b-45d5-48a6-8168-2095db71189a req-b5bc44fc-b109-4971-a7cf-177156f55570 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f0a44e1b-45d5-48a6-8168-2095db71189a req-b5bc44fc-b109-4971-a7cf-177156f55570 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-f0a44e1b-45d5-48a6-8168-2095db71189a req-b5bc44fc-b109-4971-a7cf-177156f55570 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] No waiting events found dispatching network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:25 user nova-compute[73012]: WARNING nova.compute.manager [req-f0a44e1b-45d5-48a6-8168-2095db71189a req-b5bc44fc-b109-4971-a7cf-177156f55570 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received unexpected event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a for instance with vm_state building and task_state spawning.
Aug 14 12:09:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Updating instance_info_cache with network_info: [{"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-b8939afc-76cd-47ed-9583-cb15fa0f7934 req-e96c2f58-476a-421b-974a-acf768b1cb55 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b8939afc-76cd-47ed-9583-cb15fa0f7934 req-e96c2f58-476a-421b-974a-acf768b1cb55 service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b8939afc-76cd-47ed-9583-cb15fa0f7934 req-e96c2f58-476a-421b-974a-acf768b1cb55 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b8939afc-76cd-47ed-9583-cb15fa0f7934 req-e96c2f58-476a-421b-974a-acf768b1cb55 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-b8939afc-76cd-47ed-9583-cb15fa0f7934 req-e96c2f58-476a-421b-974a-acf768b1cb55 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:27 user nova-compute[73012]: WARNING nova.compute.manager [req-b8939afc-76cd-47ed-9583-cb15fa0f7934 req-e96c2f58-476a-421b-974a-acf768b1cb55 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state building and task_state spawning.
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-b635d891-1ef8-48df-bcc5-d7c7fd55345a req-88c6641b-d14e-4af0-97e9-734220e8c6a7 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b635d891-1ef8-48df-bcc5-d7c7fd55345a req-88c6641b-d14e-4af0-97e9-734220e8c6a7 service nova] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b635d891-1ef8-48df-bcc5-d7c7fd55345a req-88c6641b-d14e-4af0-97e9-734220e8c6a7 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b635d891-1ef8-48df-bcc5-d7c7fd55345a req-88c6641b-d14e-4af0-97e9-734220e8c6a7 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-b635d891-1ef8-48df-bcc5-d7c7fd55345a req-88c6641b-d14e-4af0-97e9-734220e8c6a7 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] No waiting events found dispatching network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:27 user nova-compute[73012]: WARNING nova.compute.manager [req-b635d891-1ef8-48df-bcc5-d7c7fd55345a req-88c6641b-d14e-4af0-97e9-734220e8c6a7 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received unexpected event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a for instance with vm_state building and task_state spawning.
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014968.1908474, c2247c01-f5c8-42f3-9f16-231e7198d4e8 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] VM Resumed (Lifecycle Event)
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Instance spawned successfully.
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Instance spawned successfully.
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014968.1915696, c2247c01-f5c8-42f3-9f16-231e7198d4e8 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] VM Started (Lifecycle Event)
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014968.2228582, ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] VM Resumed (Lifecycle Event)
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Took 8.04 seconds to spawn the instance on the hypervisor.
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014968.2269385, ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] VM Started (Lifecycle Event)
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Took 8.79 seconds to build instance.
Aug 14 12:09:28 user nova-compute[73012]: INFO nova.compute.manager [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Took 8.02 seconds to build instance.
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-45a2f175-0bf8-4850-89e9-561084f39c13 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.213s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f7746a2-1167-43ff-9b63-451547297c08 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.900s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuvySNdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:09:28 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:09:28 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:09:28 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1b8413-1fc4-4194-bfc5-4648b6f4047c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:09:28 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd47ff8-96f4-48f8-9875-8c901970eff9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853] added
Aug 14 12:09:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[47467115-8544-4fba-bf57-a327c6e999fe]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[98271e74-b066-4cd6-8ceb-1645fd9ac97c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuvySNdR {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuvySNdR" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48e6e43-dfdd-4d78-8d28-bd9e6ed3e0ec]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PuvySNdR'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb6b10d-84ae-4fe6-a4bb-c3119b165321]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bec556-6215-434f-877b-6bc4004bc58b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:09:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --login" returned: 0 in 0.150s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3564972f-5b65-46c4-b69b-66d620ca5ae2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853, portal: 172.16.0.220,3260]
Aug 14 12:09:29 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853, portal: 172.16.0.220,3260] successful.
Aug 14 12:09:29 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[360267e4-8da7-406e-b74f-60134eaf34f8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dc2031-d757-4e39-a5ae-a51a2d5d311f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:29 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:29 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:29 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:29 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c3da4e-9454-496b-8127-c0b8807cf9ce]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuvySNdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.619s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] <== connect_volume: return (1623ms) {'type': 'block', 'scsi_wwn': '23965353064353633', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965353064353633', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "61e2212e-e26a-4065-b6f2-9801b2353f62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:30 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:30 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7540MB free_disk=25.74863052368164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'flavor' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:09:30 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:09:30 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:09:30 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:09:30 user nova-compute[73012]:   <serial>788e399a-6264-44c5-95ed-b689ede0f853</serial>
Aug 14 12:09:30 user nova-compute[73012]: </disk>
Aug 14 12:09:30 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 155f4cf4-3bfd-4529-bb26-529a500e61eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance dadd3d4a-74da-416f-935c-2b064ea2ec16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 29b69875-6f7d-47e1-b254-8f01e07fffa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4c2979a7-addd-4746-be89-9e5cad4cae3a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 61e2212e-e26a-4065-b6f2-9801b2353f62 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] No VIF found with MAC fa:16:3e:65:f8:c8, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.489s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:09:30 user nova-compute[73012]: INFO nova.compute.claims [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Claim successful on node user
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7d6d497b-8047-4eab-9fe8-5c0bab82f75e tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.928s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.network.neutron [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:09:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.policy [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a52866e21ac4407eb3004b69a38ce75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abf0cec2b9b4977ba86d806058ec6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:09:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Creating image(s)
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "/opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "/opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "/opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.198s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.objects.instance [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'pci_requests' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk 1073741824" returned: 0 in 0.058s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.objects.instance [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:09:32 user nova-compute[73012]: INFO nova.compute.claims [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Claim successful on node user
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.228s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Successfully created port: d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:09:32 user nova-compute[73012]: INFO nova.compute.manager [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Rescuing
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquired lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Cannot resize image /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lazy-loading 'migration_context' on Instance uuid 61e2212e-e26a-4065-b6f2-9801b2353f62 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Ensure instance console log exists: /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:09:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:32 user nova-compute[73012]: INFO nova.network.neutron [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating port b32b1a3a-9a4c-4d1d-a455-5d249794cb62 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 12:09:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Releasing lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Successfully updated port: d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquired lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "refresh_cache-61e2212e-e26a-4065-b6f2-9801b2353f62" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquired lock "refresh_cache-61e2212e-e26a-4065-b6f2-9801b2353f62" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-0f24249f-7905-4044-9455-4f76d16dbde7 req-fb421600-5861-4ba0-b379-f41984607262 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received event network-changed-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-0f24249f-7905-4044-9455-4f76d16dbde7 req-fb421600-5861-4ba0-b379-f41984607262 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Refreshing instance network info cache due to event network-changed-d0978944-aac2-4942-843b-c0b5904ee117. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0f24249f-7905-4044-9455-4f76d16dbde7 req-fb421600-5861-4ba0-b379-f41984607262 service nova] Acquiring lock "refresh_cache-61e2212e-e26a-4065-b6f2-9801b2353f62" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:09:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Instance destroyed successfully.
Aug 14 12:09:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Attempting a stable device rescue
Aug 14 12:09:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73012) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 12:09:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Instance directory exists: not creating {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 12:09:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Creating image(s)
Aug 14 12:09:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:35 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "65d2a028f2ea6472785e49d63059b5dab1641f38" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "65d2a028f2ea6472785e49d63059b5dab1641f38" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Updating instance_info_cache with network_info: [{"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Releasing lock "refresh_cache-61e2212e-e26a-4065-b6f2-9801b2353f62" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Instance network_info: |[{"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0f24249f-7905-4044-9455-4f76d16dbde7 req-fb421600-5861-4ba0-b379-f41984607262 service nova] Acquired lock "refresh_cache-61e2212e-e26a-4065-b6f2-9801b2353f62" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.network.neutron [req-0f24249f-7905-4044-9455-4f76d16dbde7 req-fb421600-5861-4ba0-b379-f41984607262 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Refreshing network info cache for port d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Start _get_guest_xml network_info=[{"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Releasing lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:09:36 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Creating image(s)
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.041s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "490de98d248b2e0bc557596501e403b206bd8b0c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "490de98d248b2e0bc557596501e403b206bd8b0c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:36 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:36 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-903219396',display_name='tempest-VolumesActionsTest-instance-903219396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-903219396',id=16,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5abf0cec2b9b4977ba86d806058ec6df',ramdisk_id='',reservation_id='r-wg6puvlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-793579565',owner_user_name='tempest-VolumesActionsTest-793579565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:32Z,user_data=None,user_id='a52866e21ac4407eb3004b69a38ce75b',uuid=61e2212e-e26a-4065-b6f2-9801b2353f62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converting VIF {"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=d0978944-aac2-4942-843b-c0b5904ee117,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0978944-aa') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lazy-loading 'pci_devices' on Instance uuid 61e2212e-e26a-4065-b6f2-9801b2353f62 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-changed-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Refreshing instance network info cache due to event network-changed-b32b1a3a-9a4c-4d1d-a455-5d249794cb62. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] Acquiring lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] Acquired lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.network.neutron [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Refreshing network info cache for port b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:09:36 user nova-compute[73012]:   <uuid>61e2212e-e26a-4065-b6f2-9801b2353f62</uuid>
Aug 14 12:09:36 user nova-compute[73012]:   <name>instance-00000010</name>
Aug 14 12:09:36 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:09:36 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:09:36 user nova-compute[73012]:   <metadata>
Aug 14 12:09:36 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:09:36 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:09:36 user nova-compute[73012]:       <nova:name>tempest-VolumesActionsTest-instance-903219396</nova:name>
Aug 14 12:09:36 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:09:36</nova:creationTime>
Aug 14 12:09:36 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:09:36 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:09:36 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:09:36 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:09:36 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:09:36 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:09:36 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:09:36 user nova-compute[73012]:       <nova:owner>
Aug 14 12:09:36 user nova-compute[73012]:         <nova:user uuid="a52866e21ac4407eb3004b69a38ce75b">tempest-VolumesActionsTest-793579565-project-member</nova:user>
Aug 14 12:09:36 user nova-compute[73012]:         <nova:project uuid="5abf0cec2b9b4977ba86d806058ec6df">tempest-VolumesActionsTest-793579565</nova:project>
Aug 14 12:09:36 user nova-compute[73012]:       </nova:owner>
Aug 14 12:09:36 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:09:36 user nova-compute[73012]:       <nova:ports>
Aug 14 12:09:36 user nova-compute[73012]:         <nova:port uuid="d0978944-aac2-4942-843b-c0b5904ee117">
Aug 14 12:09:36 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 12:09:36 user nova-compute[73012]:         </nova:port>
Aug 14 12:09:36 user nova-compute[73012]:       </nova:ports>
Aug 14 12:09:36 user nova-compute[73012]:     </nova:instance>
Aug 14 12:09:36 user nova-compute[73012]:   </metadata>
Aug 14 12:09:36 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:09:36 user nova-compute[73012]:     <system>
Aug 14 12:09:36 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:09:36 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:09:36 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:09:36 user nova-compute[73012]:       <entry name="serial">61e2212e-e26a-4065-b6f2-9801b2353f62</entry>
Aug 14 12:09:36 user nova-compute[73012]:       <entry name="uuid">61e2212e-e26a-4065-b6f2-9801b2353f62</entry>
Aug 14 12:09:36 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:09:36 user nova-compute[73012]:     </system>
Aug 14 12:09:36 user nova-compute[73012]:   </sysinfo>
Aug 14 12:09:36 user nova-compute[73012]:   <os>
Aug 14 12:09:36 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:09:36 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:09:36 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:09:36 user nova-compute[73012]:   </os>
Aug 14 12:09:36 user nova-compute[73012]:   <features>
Aug 14 12:09:36 user nova-compute[73012]:     <acpi/>
Aug 14 12:09:36 user nova-compute[73012]:     <apic/>
Aug 14 12:09:36 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:09:36 user nova-compute[73012]:   </features>
Aug 14 12:09:36 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:09:36 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:09:36 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:09:36 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:09:36 user nova-compute[73012]:   </clock>
Aug 14 12:09:36 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:09:36 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:09:36 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:09:36 user nova-compute[73012]:   </cpu>
Aug 14 12:09:36 user nova-compute[73012]:   <devices>
Aug 14 12:09:36 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:09:36 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:09:36 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk"/>
Aug 14 12:09:36 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:09:36 user nova-compute[73012]:     </disk>
Aug 14 12:09:36 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:09:36 user nova-compute[73012]:       <mac address="fa:16:3e:41:e3:1b"/>
Aug 14 12:09:36 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:36 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:09:36 user nova-compute[73012]:       <target dev="tapd0978944-aa"/>
Aug 14 12:09:36 user nova-compute[73012]:     </interface>
Aug 14 12:09:36 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:09:36 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/console.log" append="off"/>
Aug 14 12:09:36 user nova-compute[73012]:     </serial>
Aug 14 12:09:36 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:09:36 user nova-compute[73012]:     <video>
Aug 14 12:09:36 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:36 user nova-compute[73012]:     </video>
Aug 14 12:09:36 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:09:36 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:09:36 user nova-compute[73012]:     </rng>
Aug 14 12:09:36 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:09:36 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:09:36 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:09:36 user nova-compute[73012]:     </memballoon>
Aug 14 12:09:36 user nova-compute[73012]:   </devices>
Aug 14 12:09:36 user nova-compute[73012]: </domain>
Aug 14 12:09:36 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-903219396',display_name='tempest-VolumesActionsTest-instance-903219396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-903219396',id=16,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5abf0cec2b9b4977ba86d806058ec6df',ramdisk_id='',reservation_id='r-wg6puvlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-793579565',owner_user_name='tempest-VolumesActionsTest-793579565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:32Z,user_data=None,user_id='a52866e21ac4407eb3004b69a38ce75b',uuid=61e2212e-e26a-4065-b6f2-9801b2353f62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converting VIF {"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=d0978944-aac2-4942-843b-c0b5904ee117,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0978944-aa') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG os_vif [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=d0978944-aac2-4942-843b-c0b5904ee117,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0978944-aa') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38.part --force-share --output=json" returned: 0 in 0.250s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.virt.images [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] eabb7aef-3069-4f83-bb79-a52d1efe0092 was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38.part /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38.part /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38.converted" returned: 0 in 0.989s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0978944-aa, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0978944-aa, col_values=(('external_ids', {'iface-id': 'd0978944-aac2-4942-843b-c0b5904ee117', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:e3:1b', 'vm-uuid': '61e2212e-e26a-4065-b6f2-9801b2353f62'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:37 user nova-compute[73012]: INFO os_vif [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=d0978944-aac2-4942-843b-c0b5904ee117,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0978944-aa')
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c.part --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG nova.virt.images [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] acaffae4-b3cb-4de7-8e96-4c8002f06be9 was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c.part /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "65d2a028f2ea6472785e49d63059b5dab1641f38" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.491s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "65d2a028f2ea6472785e49d63059b5dab1641f38" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "65d2a028f2ea6472785e49d63059b5dab1641f38" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] No VIF found with MAC fa:16:3e:41:e3:1b, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c.part /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c.converted" returned: 0 in 0.277s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38 --force-share --output=json" returned: 0 in 0.254s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38,backing_fmt=raw /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.rescue {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38,backing_fmt=raw /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.rescue" returned: 0 in 0.064s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "65d2a028f2ea6472785e49d63059b5dab1641f38" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'migration_context' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Start _get_guest_xml network_info=[{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "vif_mac": "fa:16:3e:65:f8:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eabb7aef-3069-4f83-bb79-a52d1efe0092', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuvySNdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0d678d6a-ace6-4bcc-82af-29460c7c50cb', 'attached_at': '', 'detached_at': '', 'volume_id': '788e399a-6264-44c5-95ed-b689ede0f853', 'serial': '788e399a-6264-44c5-95ed-b689ede0f853'}, 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'f8d43797-0afb-4849-b48d-796c60bdd299', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'resources' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "490de98d248b2e0bc557596501e403b206bd8b0c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.733s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.network.neutron [req-0f24249f-7905-4044-9455-4f76d16dbde7 req-fb421600-5861-4ba0-b379-f41984607262 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Updated VIF entry in instance network info cache for port d0978944-aac2-4942-843b-c0b5904ee117. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.network.neutron [req-0f24249f-7905-4044-9455-4f76d16dbde7 req-fb421600-5861-4ba0-b379-f41984607262 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Updating instance_info_cache with network_info: [{"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:38 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:38 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0f24249f-7905-4044-9455-4f76d16dbde7 req-fb421600-5861-4ba0-b379-f41984607262 service nova] Releasing lock "refresh_cache-61e2212e-e26a-4065-b6f2-9801b2353f62" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuvySNdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:09:38 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:09:38 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:09:38 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.network.neutron [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updated VIF entry in instance network info cache for port b32b1a3a-9a4c-4d1d-a455-5d249794cb62. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.network.neutron [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "490de98d248b2e0bc557596501e403b206bd8b0c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "490de98d248b2e0bc557596501e403b206bd8b0c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5225e1e-f52d-4f9f-adb4-5aa3c971877a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PuvySNdR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 12:09:38 user nova-compute[73012]: node.name = iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853
Aug 14 12:09:38 user nova-compute[73012]: node.tpgt = -1
Aug 14 12:09:38 user nova-compute[73012]: node.startup = automatic
Aug 14 12:09:38 user nova-compute[73012]: node.leading_login = No
Aug 14 12:09:38 user nova-compute[73012]: iface.iscsi_ifacename = default
Aug 14 12:09:38 user nova-compute[73012]: iface.net_ifacename = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.ipaddress = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.prefix_len = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.hwaddress = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.transport_name = tcp
Aug 14 12:09:38 user nova-compute[73012]: iface.initiatorname = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.state = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.vlan_id = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.vlan_priority = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.vlan_state = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.iface_num = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.mtu = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.port = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.bootproto = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.subnet_mask = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.gateway = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.dhcp_alt_client_id = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.dhcp_dns = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.dhcp_learn_iqn = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.dhcp_vendor_id_state = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.dhcp_vendor_id = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.dhcp_slp_da = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.fragmentation = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.gratuitous_arp = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.incoming_forwarding = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.tos_state = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.tos = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.ttl = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.delayed_ack = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.tcp_nagle = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.tcp_wsf_state = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.tcp_wsf = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.tcp_timer_scale = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.tcp_timestamp = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.redirect = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.def_task_mgmt_timeout = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.header_digest = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.data_digest = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.immediate_data = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.initial_r2t = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.data_seq_inorder = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.data_pdu_inorder = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.erl = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.max_receive_data_len = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.first_burst_len = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.max_outstanding_r2t = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.max_burst_len = 0
Aug 14 12:09:38 user nova-compute[73012]: iface.chap_auth = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.bidi_chap = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.strict_login_compliance = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.discovery_auth = <empty>
Aug 14 12:09:38 user nova-compute[73012]: iface.discovery_logout = <empty>
Aug 14 12:09:38 user nova-compute[73012]: node.discovery_address = <empty>
Aug 14 12:09:38 user nova-compute[73012]: node.discovery_port = 0
Aug 14 12:09:38 user nova-compute[73012]: node.discovery_type = static
Aug 14 12:09:38 user nova-compute[73012]: node.session.initial_cmdsn = 0
Aug 14 12:09:38 user nova-compute[73012]: node.session.initial_login_retry_max = 8
Aug 14 12:09:38 user nova-compute[73012]: node.session.xmit_thread_priority = -20
Aug 14 12:09:38 user nova-compute[73012]: node.session.cmds_max = 128
Aug 14 12:09:38 user nova-compute[73012]: node.session.queue_depth = 32
Aug 14 12:09:38 user nova-compute[73012]: node.session.nr_sessions = 1
Aug 14 12:09:38 user nova-compute[73012]: node.session.auth.authmethod = CHAP
Aug 14 12:09:38 user nova-compute[73012]: node.session.auth.username = PuvySNdR
Aug 14 12:09:38 user nova-compute[73012]: node.session.auth.password = ***
Aug 14 12:09:38 user nova-compute[73012]: node.session.auth.username_in = <empty>
Aug 14 12:09:38 user nova-compute[73012]: node.session.auth.password_in = <empty>
Aug 14 12:09:38 user nova-compute[73012]: node.session.auth.chap_algs = MD5
Aug 14 12:09:38 user nova-compute[73012]: node.session.timeo.replacement_timeout = 120
Aug 14 12:09:38 user nova-compute[73012]: node.session.err_timeo.abort_timeout = 15
Aug 14 12:09:38 user nova-compute[73012]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 12:09:38 user nova-compute[73012]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 12:09:38 user nova-compute[73012]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.FastAbort = Yes
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.InitialR2T = No
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.ImmediateData = Yes
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.MaxConnections = 1
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 12:09:38 user nova-compute[73012]: node.session.iscsi.ERL = 0
Aug 14 12:09:38 user nova-compute[73012]: node.session.scan = manual
Aug 14 12:09:38 user nova-compute[73012]: node.session.reopen_max = 0
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].address = 172.16.0.220
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].port = 3260
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].startup = manual
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].tcp.window_size = 524288
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].tcp.type_of_service = 0
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].timeo.logout_timeout = 15
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].timeo.login_timeout = 15
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].timeo.auth_timeout = 45
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].iscsi.DataDigest = None
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].iscsi.IFMarker = No
Aug 14 12:09:38 user nova-compute[73012]: node.conn[0].iscsi.OFMarker = No
Aug 14 12:09:38 user nova-compute[73012]: # END RECORD
Aug 14 12:09:38 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] Releasing lock "refresh_cache-4c2979a7-addd-4746-be89-9e5cad4cae3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-unplugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-unplugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:38 user nova-compute[73012]: WARNING nova.compute.manager [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-unplugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state active and task_state rescuing.
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:38 user nova-compute[73012]: WARNING nova.compute.manager [req-6f44d86c-6269-4618-84c6-aafd3a0050dd req-9b400471-c811-4a4b-9261-08de06ea20ef service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state active and task_state rescuing.
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9276e58-fc27-4cde-9859-f66db46a5ae0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f4c063-ec66-4a22-bd64-a79e9bc5fa9e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuvySNdR {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuvySNdR" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9319568-0f91-4851-9450-04f26bb73555]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PuvySNdR'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f16038c-ed25-420d-baf6-84093b81be44]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b441981a-b5e2-4fc3-bcba-a472f76ee22e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:38 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:38 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:38 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:38 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.204s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] HCTL ('33', '0', '0', 0) found on session 11 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4635bb0a-ded3-42fd-af0e-3de120c38545]: (4, ('0 0 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Searching for a device in session 11 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuvySNdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.240s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] <== connect_volume: return (241ms) {'type': 'block', 'scsi_wwn': '23965353064353633', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965353064353633', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c --force-share --output=json" returned: 0 in 0.218s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c,backing_fmt=raw /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c,backing_fmt=raw /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk 1073741824" returned: 0 in 0.064s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "490de98d248b2e0bc557596501e403b206bd8b0c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-378779457',display_name='tempest-ServerStableDeviceRescueTest-server-378779457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-378779457',id=3,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhPwP5jXF/tR02HIssrEdXCa5gf+IGiWLpoNdK1pkyrsEkL2aMd5/ngo3EGORwUePP8rJ9LK39XBThbw2MQLXGlgylxkAyRX5nJ7L3mlOPge3OrXCo4mIv/6zyBAhLeXQ==',key_name='tempest-keypair-1154628437',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:05:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b0b3f5808324dc1994b2264b2a2a878',ramdisk_id='',reservation_id='r-huxlepgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1299098448',owner_user_name='tempest-ServerStableDeviceRescueTest-1299098448-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e558a10b41b4c9a9c232742b5cd3564',uuid=0d678d6a-ace6-4bcc-82af-29460c7c50cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "vif_mac": "fa:16:3e:65:f8:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Converting VIF {"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "vif_mac": "fa:16:3e:65:f8:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:f8:c8,bridge_name='br-int',has_traffic_filtering=True,id=decbb2a3-6f5c-48e3-a1ef-ee8237584aeb,network=Network(b6fdd206-2642-429e-8807-483e6d939a72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbb2a3-6f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:09:38 user nova-compute[73012]:   <uuid>0d678d6a-ace6-4bcc-82af-29460c7c50cb</uuid>
Aug 14 12:09:38 user nova-compute[73012]:   <name>instance-00000003</name>
Aug 14 12:09:38 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:09:38 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:09:38 user nova-compute[73012]:   <metadata>
Aug 14 12:09:38 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:09:38 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:09:38 user nova-compute[73012]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-378779457</nova:name>
Aug 14 12:09:38 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:09:38</nova:creationTime>
Aug 14 12:09:38 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:09:38 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:09:38 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:09:38 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:09:38 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:09:38 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:09:38 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:09:38 user nova-compute[73012]:       <nova:owner>
Aug 14 12:09:38 user nova-compute[73012]:         <nova:user uuid="7e558a10b41b4c9a9c232742b5cd3564">tempest-ServerStableDeviceRescueTest-1299098448-project-member</nova:user>
Aug 14 12:09:38 user nova-compute[73012]:         <nova:project uuid="1b0b3f5808324dc1994b2264b2a2a878">tempest-ServerStableDeviceRescueTest-1299098448</nova:project>
Aug 14 12:09:38 user nova-compute[73012]:       </nova:owner>
Aug 14 12:09:38 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:09:38 user nova-compute[73012]:       <nova:ports>
Aug 14 12:09:38 user nova-compute[73012]:         <nova:port uuid="decbb2a3-6f5c-48e3-a1ef-ee8237584aeb">
Aug 14 12:09:38 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 12:09:38 user nova-compute[73012]:         </nova:port>
Aug 14 12:09:38 user nova-compute[73012]:       </nova:ports>
Aug 14 12:09:38 user nova-compute[73012]:     </nova:instance>
Aug 14 12:09:38 user nova-compute[73012]:   </metadata>
Aug 14 12:09:38 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:09:38 user nova-compute[73012]:     <system>
Aug 14 12:09:38 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:09:38 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:09:38 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:09:38 user nova-compute[73012]:       <entry name="serial">0d678d6a-ace6-4bcc-82af-29460c7c50cb</entry>
Aug 14 12:09:38 user nova-compute[73012]:       <entry name="uuid">0d678d6a-ace6-4bcc-82af-29460c7c50cb</entry>
Aug 14 12:09:38 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:09:38 user nova-compute[73012]:     </system>
Aug 14 12:09:38 user nova-compute[73012]:   </sysinfo>
Aug 14 12:09:38 user nova-compute[73012]:   <os>
Aug 14 12:09:38 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:09:38 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:09:38 user nova-compute[73012]:   </os>
Aug 14 12:09:38 user nova-compute[73012]:   <features>
Aug 14 12:09:38 user nova-compute[73012]:     <acpi/>
Aug 14 12:09:38 user nova-compute[73012]:     <apic/>
Aug 14 12:09:38 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:09:38 user nova-compute[73012]:   </features>
Aug 14 12:09:38 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:09:38 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:09:38 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:09:38 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:09:38 user nova-compute[73012]:   </clock>
Aug 14 12:09:38 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:09:38 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:09:38 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:09:38 user nova-compute[73012]:   </cpu>
Aug 14 12:09:38 user nova-compute[73012]:   <devices>
Aug 14 12:09:38 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:09:38 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:09:38 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk"/>
Aug 14 12:09:38 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:09:38 user nova-compute[73012]:     </disk>
Aug 14 12:09:38 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:09:38 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:09:38 user nova-compute[73012]:       <source dev="/dev/sdb"/>
Aug 14 12:09:38 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:09:38 user nova-compute[73012]:       <serial>788e399a-6264-44c5-95ed-b689ede0f853</serial>
Aug 14 12:09:38 user nova-compute[73012]:     </disk>
Aug 14 12:09:38 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:09:38 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:09:38 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.rescue"/>
Aug 14 12:09:38 user nova-compute[73012]:       <target dev="vdc" bus="virtio"/>
Aug 14 12:09:38 user nova-compute[73012]:       <boot order="1"/>
Aug 14 12:09:38 user nova-compute[73012]:     </disk>
Aug 14 12:09:38 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:09:38 user nova-compute[73012]:       <mac address="fa:16:3e:65:f8:c8"/>
Aug 14 12:09:38 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:38 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:09:38 user nova-compute[73012]:       <target dev="tapdecbb2a3-6f"/>
Aug 14 12:09:38 user nova-compute[73012]:     </interface>
Aug 14 12:09:38 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:09:38 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/console.log" append="off"/>
Aug 14 12:09:38 user nova-compute[73012]:     </serial>
Aug 14 12:09:38 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:09:38 user nova-compute[73012]:     <video>
Aug 14 12:09:38 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:38 user nova-compute[73012]:     </video>
Aug 14 12:09:38 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:09:38 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:09:38 user nova-compute[73012]:     </rng>
Aug 14 12:09:38 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:09:38 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:09:38 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:09:38 user nova-compute[73012]:     </memballoon>
Aug 14 12:09:38 user nova-compute[73012]:   </devices>
Aug 14 12:09:38 user nova-compute[73012]: </domain>
Aug 14 12:09:38 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:09:38 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Instance destroyed successfully.
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'migration_context' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] No VIF found with MAC fa:16:3e:65:f8:c8, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:09:38 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Rebasing disk image.
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 -F raw /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-518dddcd-6a7f-4eba-93d0-22a56987adb9 req-e6670b4e-3036-4541-9962-2eabe30befca service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received event network-vif-plugged-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-518dddcd-6a7f-4eba-93d0-22a56987adb9 req-e6670b4e-3036-4541-9962-2eabe30befca service nova] Acquiring lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-518dddcd-6a7f-4eba-93d0-22a56987adb9 req-e6670b4e-3036-4541-9962-2eabe30befca service nova] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-518dddcd-6a7f-4eba-93d0-22a56987adb9 req-e6670b4e-3036-4541-9962-2eabe30befca service nova] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-518dddcd-6a7f-4eba-93d0-22a56987adb9 req-e6670b4e-3036-4541-9962-2eabe30befca service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] No waiting events found dispatching network-vif-plugged-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:39 user nova-compute[73012]: WARNING nova.compute.manager [req-518dddcd-6a7f-4eba-93d0-22a56987adb9 req-e6670b4e-3036-4541-9962-2eabe30befca service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received unexpected event network-vif-plugged-d0978944-aac2-4942-843b-c0b5904ee117 for instance with vm_state building and task_state spawning.
Aug 14 12:09:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:40 user nova-compute[73012]: INFO nova.compute.manager [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Terminating instance
Aug 14 12:09:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-b1c0f750-c929-4eba-b418-3e2207e6471b req-49d61b0a-4f2e-47c9-8d72-f059f4481bdd service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received event network-vif-unplugged-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b1c0f750-c929-4eba-b418-3e2207e6471b req-49d61b0a-4f2e-47c9-8d72-f059f4481bdd service nova] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b1c0f750-c929-4eba-b418-3e2207e6471b req-49d61b0a-4f2e-47c9-8d72-f059f4481bdd service nova] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b1c0f750-c929-4eba-b418-3e2207e6471b req-49d61b0a-4f2e-47c9-8d72-f059f4481bdd service nova] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-b1c0f750-c929-4eba-b418-3e2207e6471b req-49d61b0a-4f2e-47c9-8d72-f059f4481bdd service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] No waiting events found dispatching network-vif-unplugged-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-b1c0f750-c929-4eba-b418-3e2207e6471b req-49d61b0a-4f2e-47c9-8d72-f059f4481bdd service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received event network-vif-unplugged-fce00ee4-2792-4ba8-b784-985ba783b386 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 -F raw /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk" returned: 0 in 2.844s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Ensure instance console log exists: /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Start _get_guest_xml network_info=[{"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='9d9b3056316f303cad6d551e675f73b7',container_format='bare',created_at=2023-08-14T12:07:29Z,direct_url=<?>,disk_format='qcow2',id=acaffae4-b3cb-4de7-8e96-4c8002f06be9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-504953000-shelved',owner='b522100e4bf447e3b544983c451c3786',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T12:07:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCrktZly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4c2979a7-addd-4746-be89-9e5cad4cae3a', 'attached_at': '', 'detached_at': '', 'volume_id': '5b52cada-7d83-4d8d-a0c5-acc54f5adfb2', 'serial': '5b52cada-7d83-4d8d-a0c5-acc54f5adfb2'}, 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'ea2535ff-e5ca-4946-9b70-4bbb4b71b941', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:09:41 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:41 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9d9b3056316f303cad6d551e675f73b7',container_format='bare',created_at=2023-08-14T12:07:29Z,direct_url=<?>,disk_format='qcow2',id=acaffae4-b3cb-4de7-8e96-4c8002f06be9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-504953000-shelved',owner='b522100e4bf447e3b544983c451c3786',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T12:07:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.objects.instance [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCrktZly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:09:41 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:09:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.008s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:09:41 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:09:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:09:41 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260" returned: 21 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eec653-5721-4ccd-b3d6-bbef78c317e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:09:41 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:41 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Instance destroyed successfully.
Aug 14 12:09:41 user nova-compute[73012]: DEBUG nova.objects.instance [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lazy-loading 'resources' on Instance uuid ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14b061-fb7a-4459-9973-c1aa6f3520cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2] added
Aug 14 12:09:41 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-f4f03677-d676-47eb-af99-4c186f612fc8 req-fa5b3995-4404-41a4-8a92-74074501683d service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received event network-vif-plugged-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f4f03677-d676-47eb-af99-4c186f612fc8 req-fa5b3995-4404-41a4-8a92-74074501683d service nova] Acquiring lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f4f03677-d676-47eb-af99-4c186f612fc8 req-fa5b3995-4404-41a4-8a92-74074501683d service nova] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f4f03677-d676-47eb-af99-4c186f612fc8 req-fa5b3995-4404-41a4-8a92-74074501683d service nova] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-f4f03677-d676-47eb-af99-4c186f612fc8 req-fa5b3995-4404-41a4-8a92-74074501683d service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] No waiting events found dispatching network-vif-plugged-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:42 user nova-compute[73012]: WARNING nova.compute.manager [req-f4f03677-d676-47eb-af99-4c186f612fc8 req-fa5b3995-4404-41a4-8a92-74074501683d service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received unexpected event network-vif-plugged-d0978944-aac2-4942-843b-c0b5904ee117 for instance with vm_state building and task_state spawning.
Aug 14 12:09:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1333745736',display_name='tempest-TestVolumeSwap-server-1333745736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1333745736',id=7,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwMZT4vkolk2U5lO7eT+pPSYOwWwcMOjp+AsI8OWt6t5JxpsGpWb/q/2EMxXxdxPFTSq8Dl4qq/CEqPPII8t6c6Efigaxs1FTm9reB27ACjpE8O99DUtE5Dn7lcA0W38Q==',key_name='tempest-keypair-1069442216',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba5076cfad0e44389c04b5002f4578db',ramdisk_id='',reservation_id='r-nug0o7o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1775034873',owner_user_name='tempest-TestVolumeSwap-1775034873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3348290413e74695a039f4a8a611248b',uuid=ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Converting VIF {"id": "fce00ee4-2792-4ba8-b784-985ba783b386", "address": "fa:16:3e:74:34:8f", "network": {"id": "cc18f1ab-771b-422f-9729-d43c55236649", "bridge": "br-int", "label": "tempest-TestVolumeSwap-258232944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba5076cfad0e44389c04b5002f4578db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce00ee4-27", "ovs_interfaceid": "fce00ee4-2792-4ba8-b784-985ba783b386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:34:8f,bridge_name='br-int',has_traffic_filtering=True,id=fce00ee4-2792-4ba8-b784-985ba783b386,network=Network(cc18f1ab-771b-422f-9729-d43c55236649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce00ee4-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_vif [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:34:8f,bridge_name='br-int',has_traffic_filtering=True,id=fce00ee4-2792-4ba8-b784-985ba783b386,network=Network(cc18f1ab-771b-422f-9729-d43c55236649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce00ee4-27') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfce00ee4-27, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb26aab-0e54-46d7-beaf-572f36859124]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:42 user nova-compute[73012]: INFO os_vif [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:34:8f,bridge_name='br-int',has_traffic_filtering=True,id=fce00ee4-2792-4ba8-b784-985ba783b386,network=Network(cc18f1ab-771b-422f-9729-d43c55236649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce00ee4-27')
Aug 14 12:09:42 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Deleting instance files /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874_del
Aug 14 12:09:42 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Deletion of /opt/stack/data/nova/instances/ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874_del complete
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.083s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fda7a7-4d23-46cc-9db9-108d827b4427]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCrktZly {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:42 user nova-compute[73012]: INFO nova.compute.manager [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Took 2.06 seconds to destroy the instance on the hypervisor.
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCrktZly" returned: 0 in 0.119s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d2750e-5a6f-465e-84a8-9bb805a896e5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KCrktZly'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f01d37-fd37-49ed-863e-c3c99193b8c2]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb688c48-0d1a-469a-8b0a-465f7f9efa21]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:42 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:42 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:42 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:42 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-e2ef181b-9511-4d77-8243-a2245e11f20d req-497bd12b-51b5-4558-b656-631883b170bf service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e2ef181b-9511-4d77-8243-a2245e11f20d req-497bd12b-51b5-4558-b656-631883b170bf service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e2ef181b-9511-4d77-8243-a2245e11f20d req-497bd12b-51b5-4558-b656-631883b170bf service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e2ef181b-9511-4d77-8243-a2245e11f20d req-497bd12b-51b5-4558-b656-631883b170bf service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-e2ef181b-9511-4d77-8243-a2245e11f20d req-497bd12b-51b5-4558-b656-631883b170bf service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:42 user nova-compute[73012]: WARNING nova.compute.manager [req-e2ef181b-9511-4d77-8243-a2245e11f20d req-497bd12b-51b5-4558-b656-631883b170bf service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state active and task_state rescuing.
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e7234d-35bf-4444-a061-3f6443d75146]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2, portal: 172.16.0.220,3260]
Aug 14 12:09:42 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2, portal: 172.16.0.220,3260] successful.
Aug 14 12:09:42 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e76d6c-f596-440b-aed1-853e277bafbf]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f22cc5-3669-4748-9922-88c926122fd1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:42 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:42 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:09:42 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:42 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:42 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:09:42 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.627s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.067s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[689f54b0-fcbd-4fa8-b34b-2c5a3b22e035]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:09:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCrktZly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received event network-vif-plugged-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] Acquiring lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] No waiting events found dispatching network-vif-plugged-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:43 user nova-compute[73012]: WARNING nova.compute.manager [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received unexpected event network-vif-plugged-fce00ee4-2792-4ba8-b784-985ba783b386 for instance with vm_state active and task_state deleting.
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received event network-changed-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Refreshing instance network info cache due to event network-changed-26881dfb-9732-4375-a667-098ca8538791. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] Acquiring lock "refresh_cache-155f4cf4-3bfd-4529-bb26-529a500e61eb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] Acquired lock "refresh_cache-155f4cf4-3bfd-4529-bb26-529a500e61eb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.network.neutron [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Refreshing network info cache for port 26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.722s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] <== connect_volume: return (1730ms) {'type': 'block', 'scsi_wwn': '26562383461613335', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562383461613335', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-504953000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-504953000',id=2,image_ref='acaffae4-b3cb-4de7-8e96-4c8002f06be9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2108541680',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:05:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-ie3t5afq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member',shelved_at='2023-08-14T12:07:34.678604',shelved_host='user',shelved_image_id='acaffae4-b3cb-4de7-8e96-4c8002f06be9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=4c2979a7-addd-4746-be89-9e5cad4cae3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.objects.instance [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:09:43 user nova-compute[73012]:   <uuid>4c2979a7-addd-4746-be89-9e5cad4cae3a</uuid>
Aug 14 12:09:43 user nova-compute[73012]:   <name>instance-00000002</name>
Aug 14 12:09:43 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:09:43 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:09:43 user nova-compute[73012]:   <metadata>
Aug 14 12:09:43 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:09:43 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:09:43 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-504953000</nova:name>
Aug 14 12:09:43 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:09:41</nova:creationTime>
Aug 14 12:09:43 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:09:43 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:09:43 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:09:43 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:09:43 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:09:43 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:09:43 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:09:43 user nova-compute[73012]:       <nova:owner>
Aug 14 12:09:43 user nova-compute[73012]:         <nova:user uuid="7648caa38d8e4de6bf9751a512ffb14a">tempest-AttachVolumeShelveTestJSON-192114773-project-member</nova:user>
Aug 14 12:09:43 user nova-compute[73012]:         <nova:project uuid="b522100e4bf447e3b544983c451c3786">tempest-AttachVolumeShelveTestJSON-192114773</nova:project>
Aug 14 12:09:43 user nova-compute[73012]:       </nova:owner>
Aug 14 12:09:43 user nova-compute[73012]:       <nova:root type="image" uuid="acaffae4-b3cb-4de7-8e96-4c8002f06be9"/>
Aug 14 12:09:43 user nova-compute[73012]:       <nova:ports>
Aug 14 12:09:43 user nova-compute[73012]:         <nova:port uuid="b32b1a3a-9a4c-4d1d-a455-5d249794cb62">
Aug 14 12:09:43 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:09:43 user nova-compute[73012]:         </nova:port>
Aug 14 12:09:43 user nova-compute[73012]:       </nova:ports>
Aug 14 12:09:43 user nova-compute[73012]:     </nova:instance>
Aug 14 12:09:43 user nova-compute[73012]:   </metadata>
Aug 14 12:09:43 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:09:43 user nova-compute[73012]:     <system>
Aug 14 12:09:43 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:09:43 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:09:43 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:09:43 user nova-compute[73012]:       <entry name="serial">4c2979a7-addd-4746-be89-9e5cad4cae3a</entry>
Aug 14 12:09:43 user nova-compute[73012]:       <entry name="uuid">4c2979a7-addd-4746-be89-9e5cad4cae3a</entry>
Aug 14 12:09:43 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:09:43 user nova-compute[73012]:     </system>
Aug 14 12:09:43 user nova-compute[73012]:   </sysinfo>
Aug 14 12:09:43 user nova-compute[73012]:   <os>
Aug 14 12:09:43 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:09:43 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:09:43 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:09:43 user nova-compute[73012]:   </os>
Aug 14 12:09:43 user nova-compute[73012]:   <features>
Aug 14 12:09:43 user nova-compute[73012]:     <acpi/>
Aug 14 12:09:43 user nova-compute[73012]:     <apic/>
Aug 14 12:09:43 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:09:43 user nova-compute[73012]:   </features>
Aug 14 12:09:43 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:09:43 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:09:43 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:09:43 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:09:43 user nova-compute[73012]:   </clock>
Aug 14 12:09:43 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:09:43 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:09:43 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:09:43 user nova-compute[73012]:   </cpu>
Aug 14 12:09:43 user nova-compute[73012]:   <devices>
Aug 14 12:09:43 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:09:43 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:09:43 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk"/>
Aug 14 12:09:43 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:09:43 user nova-compute[73012]:     </disk>
Aug 14 12:09:43 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:09:43 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:09:43 user nova-compute[73012]:       <source dev="/dev/sdd"/>
Aug 14 12:09:43 user nova-compute[73012]:       <target dev="vdc" bus="virtio"/>
Aug 14 12:09:43 user nova-compute[73012]:       <serial>5b52cada-7d83-4d8d-a0c5-acc54f5adfb2</serial>
Aug 14 12:09:43 user nova-compute[73012]:     </disk>
Aug 14 12:09:43 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:09:43 user nova-compute[73012]:       <mac address="fa:16:3e:84:74:b4"/>
Aug 14 12:09:43 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:43 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:09:43 user nova-compute[73012]:       <target dev="tapb32b1a3a-9a"/>
Aug 14 12:09:43 user nova-compute[73012]:     </interface>
Aug 14 12:09:43 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:09:43 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/console.log" append="off"/>
Aug 14 12:09:43 user nova-compute[73012]:     </serial>
Aug 14 12:09:43 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:09:43 user nova-compute[73012]:     <video>
Aug 14 12:09:43 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:09:43 user nova-compute[73012]:     </video>
Aug 14 12:09:43 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:09:43 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:09:43 user nova-compute[73012]:     </rng>
Aug 14 12:09:43 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:09:43 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:09:43 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:09:43 user nova-compute[73012]:     </memballoon>
Aug 14 12:09:43 user nova-compute[73012]:   </devices>
Aug 14 12:09:43 user nova-compute[73012]: </domain>
Aug 14 12:09:43 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-504953000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-504953000',id=2,image_ref='acaffae4-b3cb-4de7-8e96-4c8002f06be9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2108541680',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:05:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-ie3t5afq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member',shelved_at='2023-08-14T12:07:34.678604',shelved_host='user',shelved_image_id='acaffae4-b3cb-4de7-8e96-4c8002f06be9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=4c2979a7-addd-4746-be89-9e5cad4cae3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG os_vif [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb32b1a3a-9a, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb32b1a3a-9a, col_values=(('external_ids', {'iface-id': 'b32b1a3a-9a4c-4d1d-a455-5d249794cb62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:74:b4', 'vm-uuid': '4c2979a7-addd-4746-be89-9e5cad4cae3a'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:43 user nova-compute[73012]: INFO os_vif [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a')
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] No VIF found with MAC fa:16:3e:84:74:b4, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Took 1.93 seconds to deallocate network for instance.
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Updated VIF entry in instance network info cache for port 26881dfb-9732-4375-a667-098ca8538791. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Updating instance_info_cache with network_info: [{"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f85d5bf-7d19-430f-9359-0fc9743f6d7d req-74f2f652-3988-47dd-a586-17178096c045 service nova] Releasing lock "refresh_cache-155f4cf4-3bfd-4529-bb26-529a500e61eb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Instance spawned successfully.
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014984.413033, 61e2212e-e26a-4065-b6f2-9801b2353f62 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] VM Resumed (Lifecycle Event)
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-7f749d8f-7686-40d6-92e7-56e36914feeb req-4effaa9e-9464-4b60-8a79-41a2ed925585 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7f749d8f-7686-40d6-92e7-56e36914feeb req-4effaa9e-9464-4b60-8a79-41a2ed925585 service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7f749d8f-7686-40d6-92e7-56e36914feeb req-4effaa9e-9464-4b60-8a79-41a2ed925585 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7f749d8f-7686-40d6-92e7-56e36914feeb req-4effaa9e-9464-4b60-8a79-41a2ed925585 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-7f749d8f-7686-40d6-92e7-56e36914feeb req-4effaa9e-9464-4b60-8a79-41a2ed925585 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:44 user nova-compute[73012]: WARNING nova.compute.manager [req-7f749d8f-7686-40d6-92e7-56e36914feeb req-4effaa9e-9464-4b60-8a79-41a2ed925585 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state active and task_state rescuing.
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-7f749d8f-7686-40d6-92e7-56e36914feeb req-4effaa9e-9464-4b60-8a79-41a2ed925585 service nova] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Received event network-vif-deleted-fce00ee4-2792-4ba8-b784-985ba783b386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014984.4132147, 61e2212e-e26a-4065-b6f2-9801b2353f62 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] VM Started (Lifecycle Event)
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Took 13.03 seconds to spawn the instance on the hypervisor.
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Deleted allocations for instance ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Took 14.38 seconds to build instance.
Aug 14 12:09:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a1f884d2-4c13-48e2-b323-94e06661e65e tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.496s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-25a20d0a-75c2-4bb9-b3b9-26439f2b11c9 tempest-TestVolumeSwap-1775034873 tempest-TestVolumeSwap-1775034873-project-member] Lock "ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.729s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for 0d678d6a-ace6-4bcc-82af-29460c7c50cb due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014984.868482, 0d678d6a-ace6-4bcc-82af-29460c7c50cb => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] VM Resumed (Lifecycle Event)
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9f726921-cbc6-47e1-9463-3e2c052e6428 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014984.8702474, 0d678d6a-ace6-4bcc-82af-29460c7c50cb => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:44 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] VM Started (Lifecycle Event)
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-8de2de1c-489a-4098-99ae-d753ec561903 req-29cb88de-c23f-43db-9306-69796204e430 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8de2de1c-489a-4098-99ae-d753ec561903 req-29cb88de-c23f-43db-9306-69796204e430 service nova] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8de2de1c-489a-4098-99ae-d753ec561903 req-29cb88de-c23f-43db-9306-69796204e430 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8de2de1c-489a-4098-99ae-d753ec561903 req-29cb88de-c23f-43db-9306-69796204e430 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-8de2de1c-489a-4098-99ae-d753ec561903 req-29cb88de-c23f-43db-9306-69796204e430 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] No waiting events found dispatching network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:45 user nova-compute[73012]: WARNING nova.compute.manager [req-8de2de1c-489a-4098-99ae-d753ec561903 req-29cb88de-c23f-43db-9306-69796204e430 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received unexpected event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 12:09:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-d912e6df-0712-4cf0-9539-31db6668318a req-7b7ac6fa-775e-490a-b1bc-bf6d73a81aa8 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d912e6df-0712-4cf0-9539-31db6668318a req-7b7ac6fa-775e-490a-b1bc-bf6d73a81aa8 service nova] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d912e6df-0712-4cf0-9539-31db6668318a req-7b7ac6fa-775e-490a-b1bc-bf6d73a81aa8 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d912e6df-0712-4cf0-9539-31db6668318a req-7b7ac6fa-775e-490a-b1bc-bf6d73a81aa8 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-d912e6df-0712-4cf0-9539-31db6668318a req-7b7ac6fa-775e-490a-b1bc-bf6d73a81aa8 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] No waiting events found dispatching network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:09:47 user nova-compute[73012]: WARNING nova.compute.manager [req-d912e6df-0712-4cf0-9539-31db6668318a req-7b7ac6fa-775e-490a-b1bc-bf6d73a81aa8 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received unexpected event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 12:09:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lazy-loading 'flavor' on Instance uuid 155f4cf4-3bfd-4529-bb26-529a500e61eb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:09:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:09:47 user nova-compute[73012]: INFO nova.compute.manager [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Attaching volume 7c75e4f5-5545-4bd1-8d70-6735fbda9881 to /dev/vdb
Aug 14 12:09:48 user nova-compute[73012]: DEBUG os_brick.utils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff2cb7-6da9-409a-8228-ae8894f65332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db1284c-91b3-46c5-863c-2d0569f09ed6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4bd196-99a4-423f-8fdd-bf614fd8e422]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07b8bca-bdd3-4f22-a0a5-bb3113058da5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:09:48 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7dfcdf-b4bf-4f26-9c1b-c224ae50ff55]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG os_brick.utils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Updating existing volume attachment record: 9573384f-9247-420c-9704-5b42d86b36dc {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014988.4778175, 4c2979a7-addd-4746-be89-9e5cad4cae3a => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:48 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] VM Resumed (Lifecycle Event)
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:09:48 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance spawned successfully.
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:48 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692014988.4795392, 4c2979a7-addd-4746-be89-9e5cad4cae3a => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:48 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] VM Started (Lifecycle Event)
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:09:48 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:09:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-160707fb-0010-4a6c-a39a-c301f8e5de5d tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.875s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:09:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:56 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692014981.9776146, ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:09:56 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] VM Stopped (Lifecycle Event)
Aug 14 12:09:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-59fdd617-3e18-4c67-8fda-dd73bb88be7c None None] [instance: ebdb9b9b-edb1-4a8f-b5c2-aca15bcd1874] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljTPOteq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:09:58 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:09:58 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:09:58 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1063b8d6-12b2-4ce8-adcc-39cf8760faa1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:09:58 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51597d6-8e9b-4df0-8c79-2545fa990376]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881] added
Aug 14 12:09:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eeb19c-52cf-4754-ba7e-cf28fb4aa7c7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03270e3-736e-4375-8b15-d4e99c64fbf5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljTPOteq {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljTPOteq" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f678562-1c54-40ae-a2d2-a8dbc1c4f0bc]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ljTPOteq'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b566d2-8a8b-4d6a-9661-aa8ce6fe373d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b37ba-92d9-42a8-aa27-a63139e306d2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8144e918-102b-4c88-bf3c-368654536e7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881, portal: 172.16.0.220,3260]
Aug 14 12:09:58 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881, portal: 172.16.0.220,3260] successful.
Aug 14 12:09:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c77d5-ebf1-4a8c-a78b-352f52270470]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[322dd6bc-767f-4432-83aa-4680e48b0ad8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 (non-flash)
Aug 14 12:09:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc9a3a-5853-4870-88d3-8551a1f77037]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljTPOteq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:09:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:09:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23462626136396337', 'path': '/dev/sde'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:09:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462626136396337', 'path': '/dev/sde'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:09:59 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lazy-loading 'flavor' on Instance uuid 155f4cf4-3bfd-4529-bb26-529a500e61eb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:09:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:09:59 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:09:59 user nova-compute[73012]:   <source dev="/dev/sde"/>
Aug 14 12:09:59 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:09:59 user nova-compute[73012]:   <serial>7c75e4f5-5545-4bd1-8d70-6735fbda9881</serial>
Aug 14 12:09:59 user nova-compute[73012]: </disk>
Aug 14 12:09:59 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:09:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:09:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:09:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] No VIF found with MAC fa:16:3e:cc:e1:26, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:10:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dc5769a7-6125-498a-9369-d9e7c805a3c0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.181s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:02 user nova-compute[73012]: INFO nova.compute.manager [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Detaching volume 7c75e4f5-5545-4bd1-8d70-6735fbda9881
Aug 14 12:10:02 user nova-compute[73012]: INFO nova.virt.block_device [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Attempting to driver detach volume 7c75e4f5-5545-4bd1-8d70-6735fbda9881 from mountpoint /dev/vdb
Aug 14 12:10:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Attempting to detach device vdb from instance 155f4cf4-3bfd-4529-bb26-529a500e61eb from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:10:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:10:02 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:10:02 user nova-compute[73012]:   <source dev="/dev/sde"/>
Aug 14 12:10:02 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:10:02 user nova-compute[73012]:   <serial>7c75e4f5-5545-4bd1-8d70-6735fbda9881</serial>
Aug 14 12:10:02 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:10:02 user nova-compute[73012]: </disk>
Aug 14 12:10:02 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:10:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Successfully detached device vdb from instance 155f4cf4-3bfd-4529-bb26-529a500e61eb from the persistent domain config.
Aug 14 12:10:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 155f4cf4-3bfd-4529-bb26-529a500e61eb from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:10:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:10:02 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:10:02 user nova-compute[73012]:   <source dev="/dev/sde"/>
Aug 14 12:10:02 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:10:02 user nova-compute[73012]:   <serial>7c75e4f5-5545-4bd1-8d70-6735fbda9881</serial>
Aug 14 12:10:02 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:10:02 user nova-compute[73012]: </disk>
Aug 14 12:10:02 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015003.2135165, 155f4cf4-3bfd-4529-bb26-529a500e61eb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 155f4cf4-3bfd-4529-bb26-529a500e61eb {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:10:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Successfully detached device vdb from instance 155f4cf4-3bfd-4529-bb26-529a500e61eb from the live domain config.
Aug 14 12:10:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljTPOteq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:10:03 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e35f0e-0c26-4728-af9f-464dea95a264]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d020a-8ee4-4d46-b399-444b9cbef1dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:10:03 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:10:03 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:10:03 user nova-compute[73012]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 (non-flash)
Aug 14 12:10:03 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:10:03 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:10:03 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:10:03 user nova-compute[73012]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 (non-flash)
Aug 14 12:10:03 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad06c6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881'): ({'sde'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Removing single pathed devices sde {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adf8fb1-b5b8-44e4-bcf9-d907814ab9a3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ec1485-fa6b-4209-bc52-b47cec3b46cb]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Flushing IO for device /dev/sde {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[321e5570-4517-46ed-84c9-70a20e0d8edf]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dd0705-7006-4431-9935-63c09bbf80d3]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[157e61e1-25f6-49b4-9d17-a1ba013e51b4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad45247-6d36-4531-a5af-d65bb222885e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881, portal: 172.16.0.220,3260]
Aug 14 12:10:03 user nova-compute[73012]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881, portal: 172.16.0.220,3260] successful.
Aug 14 12:10:03 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c75e4f5-5545-4bd1-8d70-6735fbda9881 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5d95e3-077b-4572-a4b9-480f039f55e5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] <== disconnect_volume: return (391ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:04 user nova-compute[73012]: DEBUG nova.objects.instance [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lazy-loading 'flavor' on Instance uuid 155f4cf4-3bfd-4529-bb26-529a500e61eb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:10:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4eea97e3-96d3-422f-9da1-191b449237f0 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.058s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:24 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:10:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:10:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:10:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:25 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:10:25 user nova-compute[73012]: INFO nova.compute.claims [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Claim successful on node user
Aug 14 12:10:25 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:10:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.policy [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10e35f53a2144a57ab7c200323cccbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae6df64fbac46eeb8de845a5b22b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:10:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Creating image(s)
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "/opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "/opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "/opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.259s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Successfully created port: 2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk 1073741824" returned: 0 in 0.069s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:10:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Cannot resize image /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lazy-loading 'migration_context' on Instance uuid 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Ensure instance console log exists: /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Successfully updated port: 2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "refresh_cache-95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquired lock "refresh_cache-95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-cc0d3215-aa4d-456b-9e9c-6646b68e27a2 req-c194d693-75ab-4677-9dfa-1f4376682e03 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received event network-changed-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-cc0d3215-aa4d-456b-9e9c-6646b68e27a2 req-c194d693-75ab-4677-9dfa-1f4376682e03 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Refreshing instance network info cache due to event network-changed-2dcf669a-ca6c-45d3-afb8-0e014f230386. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cc0d3215-aa4d-456b-9e9c-6646b68e27a2 req-c194d693-75ab-4677-9dfa-1f4376682e03 service nova] Acquiring lock "refresh_cache-95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:10:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Updating instance_info_cache with network_info: [{"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Releasing lock "refresh_cache-95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Instance network_info: |[{"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cc0d3215-aa4d-456b-9e9c-6646b68e27a2 req-c194d693-75ab-4677-9dfa-1f4376682e03 service nova] Acquired lock "refresh_cache-95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.network.neutron [req-cc0d3215-aa4d-456b-9e9c-6646b68e27a2 req-c194d693-75ab-4677-9dfa-1f4376682e03 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Refreshing network info cache for port 2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Start _get_guest_xml network_info=[{"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:10:28 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:10:28 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-558576432',display_name='tempest-ServersNegativeTestJSON-server-558576432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-558576432',id=17,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eae6df64fbac46eeb8de845a5b22b406',ramdisk_id='',reservation_id='r-h7htq8ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-78801721',owner_user_name='tempest-ServersNegativeTestJSON-78801721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:26Z,user_data=None,user_id='10e35f53a2144a57ab7c200323cccbe5',uuid=95048ac7-fa1f-42ef-8cbf-f6d2eff18d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converting VIF {"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:11:64,bridge_name='br-int',has_traffic_filtering=True,id=2dcf669a-ca6c-45d3-afb8-0e014f230386,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcf669a-ca') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lazy-loading 'pci_devices' on Instance uuid 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:10:28 user nova-compute[73012]:   <uuid>95048ac7-fa1f-42ef-8cbf-f6d2eff18d37</uuid>
Aug 14 12:10:28 user nova-compute[73012]:   <name>instance-00000011</name>
Aug 14 12:10:28 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:10:28 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:10:28 user nova-compute[73012]:   <metadata>
Aug 14 12:10:28 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:10:28 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:10:28 user nova-compute[73012]:       <nova:name>tempest-ServersNegativeTestJSON-server-558576432</nova:name>
Aug 14 12:10:28 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:10:28</nova:creationTime>
Aug 14 12:10:28 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:10:28 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:10:28 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:10:28 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:10:28 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:10:28 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:10:28 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:10:28 user nova-compute[73012]:       <nova:owner>
Aug 14 12:10:28 user nova-compute[73012]:         <nova:user uuid="10e35f53a2144a57ab7c200323cccbe5">tempest-ServersNegativeTestJSON-78801721-project-member</nova:user>
Aug 14 12:10:28 user nova-compute[73012]:         <nova:project uuid="eae6df64fbac46eeb8de845a5b22b406">tempest-ServersNegativeTestJSON-78801721</nova:project>
Aug 14 12:10:28 user nova-compute[73012]:       </nova:owner>
Aug 14 12:10:28 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:10:28 user nova-compute[73012]:       <nova:ports>
Aug 14 12:10:28 user nova-compute[73012]:         <nova:port uuid="2dcf669a-ca6c-45d3-afb8-0e014f230386">
Aug 14 12:10:28 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 12:10:28 user nova-compute[73012]:         </nova:port>
Aug 14 12:10:28 user nova-compute[73012]:       </nova:ports>
Aug 14 12:10:28 user nova-compute[73012]:     </nova:instance>
Aug 14 12:10:28 user nova-compute[73012]:   </metadata>
Aug 14 12:10:28 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:10:28 user nova-compute[73012]:     <system>
Aug 14 12:10:28 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:10:28 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:10:28 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:10:28 user nova-compute[73012]:       <entry name="serial">95048ac7-fa1f-42ef-8cbf-f6d2eff18d37</entry>
Aug 14 12:10:28 user nova-compute[73012]:       <entry name="uuid">95048ac7-fa1f-42ef-8cbf-f6d2eff18d37</entry>
Aug 14 12:10:28 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:10:28 user nova-compute[73012]:     </system>
Aug 14 12:10:28 user nova-compute[73012]:   </sysinfo>
Aug 14 12:10:28 user nova-compute[73012]:   <os>
Aug 14 12:10:28 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:10:28 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:10:28 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:10:28 user nova-compute[73012]:   </os>
Aug 14 12:10:28 user nova-compute[73012]:   <features>
Aug 14 12:10:28 user nova-compute[73012]:     <acpi/>
Aug 14 12:10:28 user nova-compute[73012]:     <apic/>
Aug 14 12:10:28 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:10:28 user nova-compute[73012]:   </features>
Aug 14 12:10:28 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:10:28 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:10:28 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:10:28 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:10:28 user nova-compute[73012]:   </clock>
Aug 14 12:10:28 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:10:28 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:10:28 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:10:28 user nova-compute[73012]:   </cpu>
Aug 14 12:10:28 user nova-compute[73012]:   <devices>
Aug 14 12:10:28 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:10:28 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:10:28 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk"/>
Aug 14 12:10:28 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:10:28 user nova-compute[73012]:     </disk>
Aug 14 12:10:28 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:10:28 user nova-compute[73012]:       <mac address="fa:16:3e:df:11:64"/>
Aug 14 12:10:28 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:10:28 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:10:28 user nova-compute[73012]:       <target dev="tap2dcf669a-ca"/>
Aug 14 12:10:28 user nova-compute[73012]:     </interface>
Aug 14 12:10:28 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:10:28 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/console.log" append="off"/>
Aug 14 12:10:28 user nova-compute[73012]:     </serial>
Aug 14 12:10:28 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:10:28 user nova-compute[73012]:     <video>
Aug 14 12:10:28 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:10:28 user nova-compute[73012]:     </video>
Aug 14 12:10:28 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:10:28 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:10:28 user nova-compute[73012]:     </rng>
Aug 14 12:10:28 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:10:28 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:10:28 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:10:28 user nova-compute[73012]:     </memballoon>
Aug 14 12:10:28 user nova-compute[73012]:   </devices>
Aug 14 12:10:28 user nova-compute[73012]: </domain>
Aug 14 12:10:28 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-558576432',display_name='tempest-ServersNegativeTestJSON-server-558576432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-558576432',id=17,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eae6df64fbac46eeb8de845a5b22b406',ramdisk_id='',reservation_id='r-h7htq8ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-78801721',owner_user_name='tempest-ServersNegativeTestJSON-78801721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:26Z,user_data=None,user_id='10e35f53a2144a57ab7c200323cccbe5',uuid=95048ac7-fa1f-42ef-8cbf-f6d2eff18d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converting VIF {"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:11:64,bridge_name='br-int',has_traffic_filtering=True,id=2dcf669a-ca6c-45d3-afb8-0e014f230386,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcf669a-ca') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG os_vif [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:11:64,bridge_name='br-int',has_traffic_filtering=True,id=2dcf669a-ca6c-45d3-afb8-0e014f230386,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcf669a-ca') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dcf669a-ca, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dcf669a-ca, col_values=(('external_ids', {'iface-id': '2dcf669a-ca6c-45d3-afb8-0e014f230386', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:11:64', 'vm-uuid': '95048ac7-fa1f-42ef-8cbf-f6d2eff18d37'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:10:28 user nova-compute[73012]: INFO os_vif [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:11:64,bridge_name='br-int',has_traffic_filtering=True,id=2dcf669a-ca6c-45d3-afb8-0e014f230386,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcf669a-ca')
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] No VIF found with MAC fa:16:3e:df:11:64, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.network.neutron [req-cc0d3215-aa4d-456b-9e9c-6646b68e27a2 req-c194d693-75ab-4677-9dfa-1f4376682e03 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Updated VIF entry in instance network info cache for port 2dcf669a-ca6c-45d3-afb8-0e014f230386. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.network.neutron [req-cc0d3215-aa4d-456b-9e9c-6646b68e27a2 req-c194d693-75ab-4677-9dfa-1f4376682e03 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Updating instance_info_cache with network_info: [{"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cc0d3215-aa4d-456b-9e9c-6646b68e27a2 req-c194d693-75ab-4677-9dfa-1f4376682e03 service nova] Releasing lock "refresh_cache-95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-d5d254eb-173e-4647-97c2-73893d7f4d36 req-97587363-c329-4ffa-a1c5-4cd4d47b24a9 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-changed-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-d5d254eb-173e-4647-97c2-73893d7f4d36 req-97587363-c329-4ffa-a1c5-4cd4d47b24a9 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing instance network info cache due to event network-changed-93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d5d254eb-173e-4647-97c2-73893d7f4d36 req-97587363-c329-4ffa-a1c5-4cd4d47b24a9 service nova] Acquiring lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d5d254eb-173e-4647-97c2-73893d7f4d36 req-97587363-c329-4ffa-a1c5-4cd4d47b24a9 service nova] Acquired lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:28 user nova-compute[73012]: DEBUG nova.network.neutron [req-d5d254eb-173e-4647-97c2-73893d7f4d36 req-97587363-c329-4ffa-a1c5-4cd4d47b24a9 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG nova.network.neutron [req-d5d254eb-173e-4647-97c2-73893d7f4d36 req-97587363-c329-4ffa-a1c5-4cd4d47b24a9 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updated VIF entry in instance network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG nova.network.neutron [req-d5d254eb-173e-4647-97c2-73893d7f4d36 req-97587363-c329-4ffa-a1c5-4cd4d47b24a9 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating instance_info_cache with network_info: [{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d5d254eb-173e-4647-97c2-73893d7f4d36 req-97587363-c329-4ffa-a1c5-4cd4d47b24a9 service nova] Releasing lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:29 user nova-compute[73012]: INFO nova.compute.manager [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Shelve offloading
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-a4617947-2aff-4a30-b02c-53a72a7c96be req-0f833c93-59f8-426b-baf8-0edaeda09249 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-unplugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a4617947-2aff-4a30-b02c-53a72a7c96be req-0f833c93-59f8-426b-baf8-0edaeda09249 service nova] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a4617947-2aff-4a30-b02c-53a72a7c96be req-0f833c93-59f8-426b-baf8-0edaeda09249 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a4617947-2aff-4a30-b02c-53a72a7c96be req-0f833c93-59f8-426b-baf8-0edaeda09249 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-a4617947-2aff-4a30-b02c-53a72a7c96be req-0f833c93-59f8-426b-baf8-0edaeda09249 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] No waiting events found dispatching network-vif-unplugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:10:30 user nova-compute[73012]: WARNING nova.compute.manager [req-a4617947-2aff-4a30-b02c-53a72a7c96be req-0f833c93-59f8-426b-baf8-0edaeda09249 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received unexpected event network-vif-unplugged-93451164-a21f-49aa-991b-a941f82c80ee for instance with vm_state active and task_state shelving.
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:30 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance destroyed successfully.
Aug 14 12:10:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquired lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG nova.network.neutron [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015032.1248136, 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:10:32 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] VM Resumed (Lifecycle Event)
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] No waiting events found dispatching network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:10:32 user nova-compute[73012]: WARNING nova.compute.manager [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received unexpected event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee for instance with vm_state active and task_state shelving.
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received event network-vif-plugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] Acquiring lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] No waiting events found dispatching network-vif-plugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:10:32 user nova-compute[73012]: WARNING nova.compute.manager [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received unexpected event network-vif-plugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 for instance with vm_state building and task_state spawning.
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received event network-vif-plugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] Acquiring lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] No waiting events found dispatching network-vif-plugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:10:32 user nova-compute[73012]: WARNING nova.compute.manager [req-f1546ecc-ef75-4439-b23c-5ca085994a5b req-1a90255f-5a25-4765-8d4a-8f308a71f966 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received unexpected event network-vif-plugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 for instance with vm_state building and task_state spawning.
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:10:32 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:10:32 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7035MB free_disk=25.556621551513672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:32 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Instance spawned successfully.
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:10:32 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015032.1251452, 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:10:32 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] VM Started (Lifecycle Event)
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:10:32 user nova-compute[73012]: INFO nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Took 6.52 seconds to spawn the instance on the hypervisor.
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:10:32 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating instance_info_cache with network_info: [{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Releasing lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 155f4cf4-3bfd-4529-bb26-529a500e61eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance dadd3d4a-74da-416f-935c-2b064ea2ec16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 29b69875-6f7d-47e1-b254-8f01e07fffa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4c2979a7-addd-4746-be89-9e5cad4cae3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 61e2212e-e26a-4065-b6f2-9801b2353f62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:10:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:10:32 user nova-compute[73012]: INFO nova.compute.manager [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Took 7.29 seconds to build instance.
Aug 14 12:10:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e380c99d-b5f5-4729-abf2-0e623e8fcdad tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.393s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance destroyed successfully.
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.objects.instance [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lazy-loading 'resources' on Instance uuid dadd3d4a-74da-416f-935c-2b064ea2ec16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1274032774',display_name='tempest-TestShelveInstance-server-1274032774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1274032774',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpvfnDao+SuLCMwRtL6cICXvUR1y5xlI3EH4m/HCXMmrxCVfeVnw3wZr2m9KhBLwd9siNn+DZrbvEClHq9XQvO7VWCT5H/PVyxJXoTl8JDpT4hI1H7VfVFKutGQiWgNJw==',key_name='tempest-TestShelveInstance-584983205',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e44af87d2aa64185ad02ba16d7cfe6b4',ramdisk_id='',reservation_id='r-thm9qhfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-588328482',owner_user_name='tempest-TestShelveInstance-588328482-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:08:56Z,user_data=None,user_id='ab939cda27a1447088d51c94b161f4d3',uuid=dadd3d4a-74da-416f-935c-2b064ea2ec16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converting VIF {"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_vif [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93451164-a2, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-c7ddbddd-5515-4776-b72a-31f4b9ab7913 req-25fde144-a9e5-443c-9e2d-add915b83327 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-changed-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-c7ddbddd-5515-4776-b72a-31f4b9ab7913 req-25fde144-a9e5-443c-9e2d-add915b83327 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing instance network info cache due to event network-changed-93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c7ddbddd-5515-4776-b72a-31f4b9ab7913 req-25fde144-a9e5-443c-9e2d-add915b83327 service nova] Acquiring lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c7ddbddd-5515-4776-b72a-31f4b9ab7913 req-25fde144-a9e5-443c-9e2d-add915b83327 service nova] Acquired lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.network.neutron [req-c7ddbddd-5515-4776-b72a-31f4b9ab7913 req-25fde144-a9e5-443c-9e2d-add915b83327 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:10:33 user nova-compute[73012]: INFO os_vif [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2')
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMgAODHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:10:33 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0c9437-3c8d-4424-895c-ac0e429e5cec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c87ce-c315-4636-8526-23813011c11d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:10:33 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:10:33 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:10:33 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:10:33 user nova-compute[73012]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:10:33 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:10:33 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad050cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcf59cc-073e-42a1-8c5e-0c6a59833d26]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[715343e1-2784-468a-a806-5208bdffbc66]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9156436a-f45e-4aaa-8cfe-3b6292745feb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17d289d-d3df-4af2-b9a8-615d2837bc92]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1436eab8-75d2-44c4-916f-848be0be351e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f2f10-fb26-4862-9a78-61cd237b3b1e]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260]
Aug 14 12:10:33 user nova-compute[73012]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260] successful.
Aug 14 12:10:33 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[839e5a13-9fc8-4394-9131-af455b43d81c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] <== disconnect_volume: return (330ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:10:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:10:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Deleting instance files /opt/stack/data/nova/instances/dadd3d4a-74da-416f-935c-2b064ea2ec16_del
Aug 14 12:10:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Deletion of /opt/stack/data/nova/instances/dadd3d4a-74da-416f-935c-2b064ea2ec16_del complete
Aug 14 12:10:34 user nova-compute[73012]: DEBUG nova.network.neutron [req-c7ddbddd-5515-4776-b72a-31f4b9ab7913 req-25fde144-a9e5-443c-9e2d-add915b83327 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updated VIF entry in instance network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG nova.network.neutron [req-c7ddbddd-5515-4776-b72a-31f4b9ab7913 req-25fde144-a9e5-443c-9e2d-add915b83327 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating instance_info_cache with network_info: [{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": null, "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap93451164-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c7ddbddd-5515-4776-b72a-31f4b9ab7913 req-25fde144-a9e5-443c-9e2d-add915b83327 service nova] Releasing lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:10:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:35 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Deleted allocations for instance dadd3d4a-74da-416f-935c-2b064ea2ec16
Aug 14 12:10:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:35 user nova-compute[73012]: DEBUG nova.objects.instance [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lazy-loading 'numa_topology' on Instance uuid dadd3d4a-74da-416f-935c-2b064ea2ec16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:10:35 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:10:35 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:10:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-effec7db-e4f9-4e4c-8534-c7aff694077e tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.975s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-b14adedf-2a0e-41b2-bd2d-bd646cd457d1 req-a137ff19-8069-442e-bab6-dc634aa84b2f service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received event network-changed-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-b14adedf-2a0e-41b2-bd2d-bd646cd457d1 req-a137ff19-8069-442e-bab6-dc634aa84b2f service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Refreshing instance network info cache due to event network-changed-705f8ea2-972b-4194-ba28-1a16d9742dc4. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:10:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b14adedf-2a0e-41b2-bd2d-bd646cd457d1 req-a137ff19-8069-442e-bab6-dc634aa84b2f service nova] Acquiring lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b14adedf-2a0e-41b2-bd2d-bd646cd457d1 req-a137ff19-8069-442e-bab6-dc634aa84b2f service nova] Acquired lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-b14adedf-2a0e-41b2-bd2d-bd646cd457d1 req-a137ff19-8069-442e-bab6-dc634aa84b2f service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Refreshing network info cache for port 705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:10:43 user nova-compute[73012]: DEBUG nova.network.neutron [req-b14adedf-2a0e-41b2-bd2d-bd646cd457d1 req-a137ff19-8069-442e-bab6-dc634aa84b2f service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updated VIF entry in instance network info cache for port 705f8ea2-972b-4194-ba28-1a16d9742dc4. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:10:43 user nova-compute[73012]: DEBUG nova.network.neutron [req-b14adedf-2a0e-41b2-bd2d-bd646cd457d1 req-a137ff19-8069-442e-bab6-dc634aa84b2f service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updating instance_info_cache with network_info: [{"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b14adedf-2a0e-41b2-bd2d-bd646cd457d1 req-a137ff19-8069-442e-bab6-dc634aa84b2f service nova] Releasing lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:45 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015030.6133409, dadd3d4a-74da-416f-935c-2b064ea2ec16 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:10:45 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] VM Stopped (Lifecycle Event)
Aug 14 12:10:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bdf37d37-76fb-46dd-9d88-0511bf6c9313 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:10:47 user nova-compute[73012]: INFO nova.compute.claims [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Claim successful on node user
Aug 14 12:10:47 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:10:47 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:10:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:10:47 user nova-compute[73012]: INFO nova.virt.block_device [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Booting with volume 99f5ea2f-fb71-4a59-b30b-8087d20eda29 at /dev/vda
Aug 14 12:10:47 user nova-compute[73012]: DEBUG os_brick.utils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d390fef-5c2c-4764-ba15-02ba29da0492]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8cd57e-0c9a-4b99-b800-c5d2f384a5b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c592cf3-b44b-45e7-9610-0d8915d3d2be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c2243c-3460-4259-99dd-511fc4a157af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:10:47 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:10:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a2c287-b3cb-4b1c-8420-f6a917a8f4bd]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG os_brick.utils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating existing volume attachment record: 0bd08146-18ed-47b1-a479-e4eef11da4f1 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG nova.policy [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df4acd9a2410441795c6a397946130cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0f9d241b964ed3a36a9bb4b590ef6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "29b69875-6f7d-47e1-b254-8f01e07fffa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:48 user nova-compute[73012]: INFO nova.compute.manager [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Terminating instance
Aug 14 12:10:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Instance destroyed successfully.
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lazy-loading 'resources' on Instance uuid 29b69875-6f7d-47e1-b254-8f01e07fffa3 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-8a175995-8887-42b0-8e81-d2ca44543de7 req-eb71fa2b-d3c1-4a15-b158-99c4ac23dfe2 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received event network-vif-unplugged-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8a175995-8887-42b0-8e81-d2ca44543de7 req-eb71fa2b-d3c1-4a15-b158-99c4ac23dfe2 service nova] Acquiring lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8a175995-8887-42b0-8e81-d2ca44543de7 req-eb71fa2b-d3c1-4a15-b158-99c4ac23dfe2 service nova] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8a175995-8887-42b0-8e81-d2ca44543de7 req-eb71fa2b-d3c1-4a15-b158-99c4ac23dfe2 service nova] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-8a175995-8887-42b0-8e81-d2ca44543de7 req-eb71fa2b-d3c1-4a15-b158-99c4ac23dfe2 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] No waiting events found dispatching network-vif-unplugged-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-8a175995-8887-42b0-8e81-d2ca44543de7 req-eb71fa2b-d3c1-4a15-b158-99c4ac23dfe2 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received event network-vif-unplugged-bf8b8d7b-697a-4565-9904-063b2e35241f for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1323330538',display_name='tempest-VolumesAdminNegativeTest-server-1323330538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1323330538',id=12,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:08:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2210f703a6814803bcfb4266d264b0f5',ramdisk_id='',reservation_id='r-00t3aeyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-384894799',owner_user_name='tempest-VolumesAdminNegativeTest-384894799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:08:56Z,user_data=None,user_id='9442db73842a465493b2e020a0977cce',uuid=29b69875-6f7d-47e1-b254-8f01e07fffa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converting VIF {"id": "bf8b8d7b-697a-4565-9904-063b2e35241f", "address": "fa:16:3e:58:ec:4b", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf8b8d7b-69", "ovs_interfaceid": "bf8b8d7b-697a-4565-9904-063b2e35241f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf8b8d7b-697a-4565-9904-063b2e35241f,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8b8d7b-69') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG os_vif [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf8b8d7b-697a-4565-9904-063b2e35241f,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8b8d7b-69') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf8b8d7b-69, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:10:49 user nova-compute[73012]: INFO os_vif [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf8b8d7b-697a-4565-9904-063b2e35241f,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf8b8d7b-69')
Aug 14 12:10:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Deleting instance files /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3_del
Aug 14 12:10:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Deletion of /opt/stack/data/nova/instances/29b69875-6f7d-47e1-b254-8f01e07fffa3_del complete
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully created port: 5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:10:49 user nova-compute[73012]: INFO nova.compute.manager [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 12:10:49 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:10:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:50 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:50 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Took 0.94 seconds to deallocate network for instance.
Aug 14 12:10:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully created port: 1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:10:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:50 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:10:50 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:10:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:50 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Deleted allocations for instance 29b69875-6f7d-47e1-b254-8f01e07fffa3
Aug 14 12:10:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully created port: 63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:10:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e604e1e8-36e5-45ff-9726-d15ad3ef8a59 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.492s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-0b6978ed-9549-41f7-9c53-60c7f6a8c60f req-4ec71fef-aeba-4ca5-95a5-dcdfb2659c45 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received event network-vif-plugged-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0b6978ed-9549-41f7-9c53-60c7f6a8c60f req-4ec71fef-aeba-4ca5-95a5-dcdfb2659c45 service nova] Acquiring lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0b6978ed-9549-41f7-9c53-60c7f6a8c60f req-4ec71fef-aeba-4ca5-95a5-dcdfb2659c45 service nova] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0b6978ed-9549-41f7-9c53-60c7f6a8c60f req-4ec71fef-aeba-4ca5-95a5-dcdfb2659c45 service nova] Lock "29b69875-6f7d-47e1-b254-8f01e07fffa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-0b6978ed-9549-41f7-9c53-60c7f6a8c60f req-4ec71fef-aeba-4ca5-95a5-dcdfb2659c45 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] No waiting events found dispatching network-vif-plugged-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:10:51 user nova-compute[73012]: WARNING nova.compute.manager [req-0b6978ed-9549-41f7-9c53-60c7f6a8c60f req-4ec71fef-aeba-4ca5-95a5-dcdfb2659c45 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received unexpected event network-vif-plugged-bf8b8d7b-697a-4565-9904-063b2e35241f for instance with vm_state deleted and task_state None.
Aug 14 12:10:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-0b6978ed-9549-41f7-9c53-60c7f6a8c60f req-4ec71fef-aeba-4ca5-95a5-dcdfb2659c45 service nova] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Received event network-vif-deleted-bf8b8d7b-697a-4565-9904-063b2e35241f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully created port: 78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:10:52 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully created port: f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:10:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully updated port: 5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:10:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-13c5bbab-0636-4848-b3c5-b3e8322da9b3 req-e3c5d414-6457-46bc-9171-aaae5bc335f7 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-changed-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-13c5bbab-0636-4848-b3c5-b3e8322da9b3 req-e3c5d414-6457-46bc-9171-aaae5bc335f7 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing instance network info cache due to event network-changed-5e30ee37-0c0f-48b1-8719-f949bcf47c10. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:10:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-13c5bbab-0636-4848-b3c5-b3e8322da9b3 req-e3c5d414-6457-46bc-9171-aaae5bc335f7 service nova] Acquiring lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-13c5bbab-0636-4848-b3c5-b3e8322da9b3 req-e3c5d414-6457-46bc-9171-aaae5bc335f7 service nova] Acquired lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:53 user nova-compute[73012]: DEBUG nova.network.neutron [req-13c5bbab-0636-4848-b3c5-b3e8322da9b3 req-e3c5d414-6457-46bc-9171-aaae5bc335f7 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing network info cache for port 5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:10:53 user nova-compute[73012]: DEBUG nova.network.neutron [req-13c5bbab-0636-4848-b3c5-b3e8322da9b3 req-e3c5d414-6457-46bc-9171-aaae5bc335f7 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:10:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:54 user nova-compute[73012]: DEBUG nova.network.neutron [req-13c5bbab-0636-4848-b3c5-b3e8322da9b3 req-e3c5d414-6457-46bc-9171-aaae5bc335f7 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-13c5bbab-0636-4848-b3c5-b3e8322da9b3 req-e3c5d414-6457-46bc-9171-aaae5bc335f7 service nova] Releasing lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:55 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully updated port: 94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:10:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-a32ac91b-7f0f-49fb-ad2a-435b5407c0da req-08fca1a7-38d2-44d9-a95f-f129944a6086 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-changed-94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-a32ac91b-7f0f-49fb-ad2a-435b5407c0da req-08fca1a7-38d2-44d9-a95f-f129944a6086 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing instance network info cache due to event network-changed-94f3ff54-1015-4d97-a5d8-1700aa55cd98. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:10:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a32ac91b-7f0f-49fb-ad2a-435b5407c0da req-08fca1a7-38d2-44d9-a95f-f129944a6086 service nova] Acquiring lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a32ac91b-7f0f-49fb-ad2a-435b5407c0da req-08fca1a7-38d2-44d9-a95f-f129944a6086 service nova] Acquired lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-a32ac91b-7f0f-49fb-ad2a-435b5407c0da req-08fca1a7-38d2-44d9-a95f-f129944a6086 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing network info cache for port 94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:10:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-a32ac91b-7f0f-49fb-ad2a-435b5407c0da req-08fca1a7-38d2-44d9-a95f-f129944a6086 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:10:56 user nova-compute[73012]: DEBUG nova.network.neutron [req-a32ac91b-7f0f-49fb-ad2a-435b5407c0da req-08fca1a7-38d2-44d9-a95f-f129944a6086 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a32ac91b-7f0f-49fb-ad2a-435b5407c0da req-08fca1a7-38d2-44d9-a95f-f129944a6086 service nova] Releasing lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:56 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully updated port: ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully updated port: 1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:10:57 user nova-compute[73012]: INFO nova.virt.block_device [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Booting with volume 0d8081d7-762e-42a3-9656-0fd0ebf7ac8a at /dev/vdb
Aug 14 12:10:57 user nova-compute[73012]: DEBUG os_brick.utils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b3f1cd-fe69-4645-88c5-a99d68a78a86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e4c94-ff19-446c-ab57-07778eb95457]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae564a-0e44-4dfb-b962-aa913272e42f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[995b12b5-425e-43d1-87bb-2d53b0886f80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:10:57 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[722f516d-0e5d-49c3-bb58-1ed27bf413c7]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG os_brick.utils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating existing volume attachment record: 00cb30cc-434c-4ecd-ab87-33ee5b26218e {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-changed-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing instance network info cache due to event network-changed-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] Acquiring lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] Acquired lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG nova.network.neutron [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing network info cache for port ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG nova.network.neutron [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:10:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully updated port: 63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] Releasing lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-changed-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing instance network info cache due to event network-changed-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] Acquiring lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] Acquired lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing network info cache for port 1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:10:58 user nova-compute[73012]: INFO nova.compute.manager [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Terminating instance
Aug 14 12:10:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:10:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecf90f1a-bfe3-4b5c-a4b0-abe2432514aa req-4a64c4cf-9eba-4f0f-993a-127f25281247 service nova] Releasing lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Instance destroyed successfully.
Aug 14 12:10:59 user nova-compute[73012]: DEBUG nova.objects.instance [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lazy-loading 'resources' on Instance uuid 155f4cf4-3bfd-4529-bb26-529a500e61eb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-125341889',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-125341889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1253418',id=10,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+9Udl1ar2EtSlZ55/X2JbVR8IG+gv303XaT36DX1mMay+ahtNoBoibmnnYPvNoz7TabC0d8aP03/ndlyBYdUHgDty31rPT5Lk9liKtvN9OO/9dKzHipifKuhGOsU+/Bg==',key_name='tempest-keypair-1621558607',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54fb585a888b4a7499315cd87da2c315',ramdisk_id='',reservation_id='r-mg2y5t0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1660840996',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5835e834cb846f795b3f13fa68bbec0',uuid=155f4cf4-3bfd-4529-bb26-529a500e61eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Converting VIF {"id": "26881dfb-9732-4375-a667-098ca8538791", "address": "fa:16:3e:cc:e1:26", "network": {"id": "c587c329-76aa-485a-837b-f751cd67bdb0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1706208992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fb585a888b4a7499315cd87da2c315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26881dfb-97", "ovs_interfaceid": "26881dfb-9732-4375-a667-098ca8538791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e1:26,bridge_name='br-int',has_traffic_filtering=True,id=26881dfb-9732-4375-a667-098ca8538791,network=Network(c587c329-76aa-485a-837b-f751cd67bdb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26881dfb-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG os_vif [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e1:26,bridge_name='br-int',has_traffic_filtering=True,id=26881dfb-9732-4375-a667-098ca8538791,network=Network(c587c329-76aa-485a-837b-f751cd67bdb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26881dfb-97') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26881dfb-97, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:59 user nova-compute[73012]: INFO os_vif [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e1:26,bridge_name='br-int',has_traffic_filtering=True,id=26881dfb-9732-4375-a667-098ca8538791,network=Network(c587c329-76aa-485a-837b-f751cd67bdb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26881dfb-97')
Aug 14 12:10:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Deleting instance files /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb_del
Aug 14 12:10:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Deletion of /opt/stack/data/nova/instances/155f4cf4-3bfd-4529-bb26-529a500e61eb_del complete
Aug 14 12:10:59 user nova-compute[73012]: INFO nova.compute.manager [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 12:10:59 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-changed-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing instance network info cache due to event network-changed-63039d69-9348-496a-9acc-7a527f14c14d. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] Acquiring lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] Acquired lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing network info cache for port 63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:10:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully updated port: 78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:11:00 user nova-compute[73012]: DEBUG nova.network.neutron [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] Releasing lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received event network-vif-unplugged-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] No waiting events found dispatching network-vif-unplugged-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-c2473552-6b2e-42ef-933d-44b61307ed80 req-ea406ac3-6590-4a84-b446-181548576bb6 service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received event network-vif-unplugged-26881dfb-9732-4375-a667-098ca8538791 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:01 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Took 1.80 seconds to deallocate network for instance.
Aug 14 12:11:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Successfully updated port: f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquired lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:11:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:01 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Deleted allocations for instance 155f4cf4-3bfd-4529-bb26-529a500e61eb
Aug 14 12:11:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received event network-vif-plugged-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] Acquiring lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] No waiting events found dispatching network-vif-plugged-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:02 user nova-compute[73012]: WARNING nova.compute.manager [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received unexpected event network-vif-plugged-26881dfb-9732-4375-a667-098ca8538791 for instance with vm_state deleted and task_state None.
Aug 14 12:11:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-changed-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing instance network info cache due to event network-changed-78c215c5-4cf9-407c-8f72-927553c1b299. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] Acquiring lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8c242d57-8089-4763-85dc-9173144219e6 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996 tempest-TestServerVolumeAttachScenarioOldVersion-1660840996-project-member] Lock "155f4cf4-3bfd-4529-bb26-529a500e61eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.499s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:04 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015049.186065, 29b69875-6f7d-47e1-b254-8f01e07fffa3 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:11:04 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] VM Stopped (Lifecycle Event)
Aug 14 12:11:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e5a92b37-265d-42d3-b188-2b782c79bf3d None None] [instance: 29b69875-6f7d-47e1-b254-8f01e07fffa3] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:04 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [{"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Releasing lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance network_info: |[{"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:11:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] Acquired lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:04 user nova-compute[73012]: DEBUG nova.network.neutron [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing network info cache for port 78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updated VIF entry in instance network info cache for port 78c215c5-4cf9-407c-8f72-927553c1b299. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [{"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] Releasing lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Received event network-vif-deleted-26881dfb-9732-4375-a667-098ca8538791 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-changed-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing instance network info cache due to event network-changed-f1f01a68-a0eb-4d18-8d8d-80097ae41d56. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] Acquiring lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] Acquired lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing network info cache for port f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updated VIF entry in instance network info cache for port f1f01a68-a0eb-4d18-8d8d-80097ae41d56. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [{"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-07aa052a-0476-4b8a-823d-bf836fa7d49a req-01815a30-6e1d-40d9-b34a-b49b238ebbed service nova] Releasing lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:07 user nova-compute[73012]: INFO nova.virt.block_device [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Booting with volume d51b32a3-b7e5-41de-b018-2e1120de2f08 at /dev/vdc
Aug 14 12:11:07 user nova-compute[73012]: DEBUG os_brick.utils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc556f06-0174-417e-94e7-af3987566e2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3b5d2a-5157-4446-a3d9-8ea90eb6febb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3640810-1f78-4c16-b07b-070bc8cbc922]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a25c133-b7ba-45a9-8fd7-6cceee7c63c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:11:07 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:11:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a890f1-933d-4a4c-a3c5-6793df11be51]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG os_brick.utils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:11:07 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating existing volume attachment record: 81453e66-7cad-4fed-a65b-4ef232feb9f5 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:11:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:10 user nova-compute[73012]: INFO nova.compute.manager [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Rescuing
Aug 14 12:11:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquired lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:11:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Updating instance_info_cache with network_info: [{"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Releasing lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-b848e7dc-7186-4846-854a-6bc921741093 req-d38307cd-b684-473a-bf2a-f8ce8103b8e7 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-unplugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b848e7dc-7186-4846-854a-6bc921741093 req-d38307cd-b684-473a-bf2a-f8ce8103b8e7 service nova] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b848e7dc-7186-4846-854a-6bc921741093 req-d38307cd-b684-473a-bf2a-f8ce8103b8e7 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b848e7dc-7186-4846-854a-6bc921741093 req-d38307cd-b684-473a-bf2a-f8ce8103b8e7 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-b848e7dc-7186-4846-854a-6bc921741093 req-d38307cd-b684-473a-bf2a-f8ce8103b8e7 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] No waiting events found dispatching network-vif-unplugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:12 user nova-compute[73012]: WARNING nova.compute.manager [req-b848e7dc-7186-4846-854a-6bc921741093 req-d38307cd-b684-473a-bf2a-f8ce8103b8e7 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received unexpected event network-vif-unplugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a for instance with vm_state active and task_state rescuing.
Aug 14 12:11:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Instance destroyed successfully.
Aug 14 12:11:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Attempting rescue
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73012) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Instance directory exists: not creating {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 12:11:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Creating image(s)
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:12 user nova-compute[73012]: INFO nova.compute.manager [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Detaching volume 5b52cada-7d83-4d8d-a0c5-acc54f5adfb2
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:12 user nova-compute[73012]: INFO nova.virt.block_device [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Attempting to driver detach volume 5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 from mountpoint /dev/vdc
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Attempting to detach device vdc from instance 4c2979a7-addd-4746-be89-9e5cad4cae3a from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:11:12 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:11:12 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:11:12 user nova-compute[73012]:   <target dev="vdc" bus="virtio"/>
Aug 14 12:11:12 user nova-compute[73012]:   <serial>5b52cada-7d83-4d8d-a0c5-acc54f5adfb2</serial>
Aug 14 12:11:12 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 12:11:12 user nova-compute[73012]: </disk>
Aug 14 12:11:12 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue" returned: 0 in 0.060s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'migration_context' on Instance uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully detached device vdc from instance 4c2979a7-addd-4746-be89-9e5cad4cae3a from the persistent domain config.
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4c2979a7-addd-4746-be89-9e5cad4cae3a from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:11:12 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:11:12 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:11:12 user nova-compute[73012]:   <target dev="vdc" bus="virtio"/>
Aug 14 12:11:12 user nova-compute[73012]:   <serial>5b52cada-7d83-4d8d-a0c5-acc54f5adfb2</serial>
Aug 14 12:11:12 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 12:11:12 user nova-compute[73012]: </disk>
Aug 14 12:11:12 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Start _get_guest_xml network_info=[{"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "vif_mac": "fa:16:3e:e6:fd:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'resources' on Instance uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'numa_topology' on Instance uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:11:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1536270',display_name='tempest-ServerRescueNegativeTestJSON-server-1536270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1536270',id=15,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-6d0napzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:28Z,user_data=None,user_id='e7128922092841c49b475af30075e458',uuid=ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "vif_mac": "fa:16:3e:e6:fd:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "vif_mac": "fa:16:3e:e6:fd:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fd:85,bridge_name='br-int',has_traffic_filtering=True,id=8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5e5b4d-d3') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'pci_devices' on Instance uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:11:12 user nova-compute[73012]:   <uuid>ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e</uuid>
Aug 14 12:11:12 user nova-compute[73012]:   <name>instance-0000000f</name>
Aug 14 12:11:12 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:11:12 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:11:12 user nova-compute[73012]:   <metadata>
Aug 14 12:11:12 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:11:12 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:11:12 user nova-compute[73012]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1536270</nova:name>
Aug 14 12:11:12 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:11:12</nova:creationTime>
Aug 14 12:11:12 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:11:12 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:11:12 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:11:12 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:11:12 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:11:12 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:11:12 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:11:12 user nova-compute[73012]:       <nova:owner>
Aug 14 12:11:12 user nova-compute[73012]:         <nova:user uuid="e7128922092841c49b475af30075e458">tempest-ServerRescueNegativeTestJSON-334705254-project-member</nova:user>
Aug 14 12:11:12 user nova-compute[73012]:         <nova:project uuid="96ac2852176e4d7580080e2320371fe8">tempest-ServerRescueNegativeTestJSON-334705254</nova:project>
Aug 14 12:11:12 user nova-compute[73012]:       </nova:owner>
Aug 14 12:11:12 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:11:12 user nova-compute[73012]:       <nova:ports>
Aug 14 12:11:12 user nova-compute[73012]:         <nova:port uuid="8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a">
Aug 14 12:11:12 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 12:11:12 user nova-compute[73012]:         </nova:port>
Aug 14 12:11:12 user nova-compute[73012]:       </nova:ports>
Aug 14 12:11:12 user nova-compute[73012]:     </nova:instance>
Aug 14 12:11:12 user nova-compute[73012]:   </metadata>
Aug 14 12:11:12 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:11:12 user nova-compute[73012]:     <system>
Aug 14 12:11:12 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:11:12 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:11:12 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:11:12 user nova-compute[73012]:       <entry name="serial">ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e</entry>
Aug 14 12:11:12 user nova-compute[73012]:       <entry name="uuid">ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e</entry>
Aug 14 12:11:12 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:11:12 user nova-compute[73012]:     </system>
Aug 14 12:11:12 user nova-compute[73012]:   </sysinfo>
Aug 14 12:11:12 user nova-compute[73012]:   <os>
Aug 14 12:11:12 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:11:12 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:11:12 user nova-compute[73012]:   </os>
Aug 14 12:11:12 user nova-compute[73012]:   <features>
Aug 14 12:11:12 user nova-compute[73012]:     <acpi/>
Aug 14 12:11:12 user nova-compute[73012]:     <apic/>
Aug 14 12:11:12 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:11:12 user nova-compute[73012]:   </features>
Aug 14 12:11:12 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:11:12 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:11:12 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:11:12 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:11:12 user nova-compute[73012]:   </clock>
Aug 14 12:11:12 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:11:12 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:11:12 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:11:12 user nova-compute[73012]:   </cpu>
Aug 14 12:11:12 user nova-compute[73012]:   <devices>
Aug 14 12:11:12 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:11:12 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:11:12 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue"/>
Aug 14 12:11:12 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:11:12 user nova-compute[73012]:     </disk>
Aug 14 12:11:12 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:11:12 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:11:12 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk"/>
Aug 14 12:11:12 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:11:12 user nova-compute[73012]:     </disk>
Aug 14 12:11:12 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:11:12 user nova-compute[73012]:       <mac address="fa:16:3e:e6:fd:85"/>
Aug 14 12:11:12 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:12 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:11:12 user nova-compute[73012]:       <target dev="tap8e5e5b4d-d3"/>
Aug 14 12:11:12 user nova-compute[73012]:     </interface>
Aug 14 12:11:12 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:11:12 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/console.log" append="off"/>
Aug 14 12:11:12 user nova-compute[73012]:     </serial>
Aug 14 12:11:12 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:11:12 user nova-compute[73012]:     <video>
Aug 14 12:11:12 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:12 user nova-compute[73012]:     </video>
Aug 14 12:11:12 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:11:12 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:11:12 user nova-compute[73012]:     </rng>
Aug 14 12:11:12 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:11:12 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:11:12 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:11:12 user nova-compute[73012]:     </memballoon>
Aug 14 12:11:12 user nova-compute[73012]:   </devices>
Aug 14 12:11:12 user nova-compute[73012]: </domain>
Aug 14 12:11:12 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:11:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Instance destroyed successfully.
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:11:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No VIF found with MAC fa:16:3e:e6:fd:85, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015073.1972156, 4c2979a7-addd-4746-be89-9e5cad4cae3a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:11:13 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully detached device vdc from instance 4c2979a7-addd-4746-be89-9e5cad4cae3a from the live domain config.
Aug 14 12:11:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCrktZly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:11:13 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7be86f-3839-44d4-8883-d87c4ebbb2ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c3d81b-d3f3-4829-9de5-750d6775cd1b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:13 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:11:13 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:13 user nova-compute[73012]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 (non-flash)
Aug 14 12:11:13 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad013dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd8f89-eda7-445a-88fc-cdd017995684]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec02e9e9-defc-42cb-a5aa-271adfddbf4c]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a15000-ec2b-4144-9164-714eb4faacea]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb617c8-b649-4bd8-ae1c-b1161b2bacfd]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e12026-ce2f-4ccb-b322-d1a4ff414a21]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f3b7a5-cabb-4854-add6-fafc13d50fed]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2, portal: 172.16.0.220,3260]
Aug 14 12:11:13 user nova-compute[73012]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2, portal: 172.16.0.220,3260] successful.
Aug 14 12:11:13 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b52cada-7d83-4d8d-a0c5-acc54f5adfb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7acbfc-bec6-4afc-8f9a-f5ad6f6fd392]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] <== disconnect_volume: return (300ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:11:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-28b8c89b-5161-43a4-a452-c0fbed8599cf req-95342326-978e-484a-965e-e22c53b9c5e4 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-28b8c89b-5161-43a4-a452-c0fbed8599cf req-95342326-978e-484a-965e-e22c53b9c5e4 service nova] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-28b8c89b-5161-43a4-a452-c0fbed8599cf req-95342326-978e-484a-965e-e22c53b9c5e4 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-28b8c89b-5161-43a4-a452-c0fbed8599cf req-95342326-978e-484a-965e-e22c53b9c5e4 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-28b8c89b-5161-43a4-a452-c0fbed8599cf req-95342326-978e-484a-965e-e22c53b9c5e4 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] No waiting events found dispatching network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:14 user nova-compute[73012]: WARNING nova.compute.manager [req-28b8c89b-5161-43a4-a452-c0fbed8599cf req-95342326-978e-484a-965e-e22c53b9c5e4 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received unexpected event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a for instance with vm_state active and task_state rescuing.
Aug 14 12:11:14 user nova-compute[73012]: DEBUG nova.objects.instance [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'flavor' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-47d8c928-5a40-479f-8e17-63e761a66967 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.734s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015059.3487954, 155f4cf4-3bfd-4529-bb26-529a500e61eb => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:11:14 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] VM Stopped (Lifecycle Event)
Aug 14 12:11:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-76e6bb5a-b8c7-4c4a-9805-3d824c98b665 None None] [instance: 155f4cf4-3bfd-4529-bb26-529a500e61eb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] No waiting events found dispatching network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:16 user nova-compute[73012]: WARNING nova.compute.manager [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received unexpected event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a for instance with vm_state active and task_state rescuing.
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] No waiting events found dispatching network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:16 user nova-compute[73012]: WARNING nova.compute.manager [req-3eab86a2-8a2c-43e4-bf20-fbb2397ca153 req-4a2b1993-5c87-4ada-8460-46701f508261 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received unexpected event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a for instance with vm_state active and task_state rescuing.
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015076.7315762, ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:11:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] VM Resumed (Lifecycle Event)
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-157b3ae8-a011-443c-987a-677acec8852a tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:11:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015076.7333558, ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:11:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] VM Started (Lifecycle Event)
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:11:17 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Creating image(s)
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Ensure instance console log exists: /opt/stack/data/nova/instances/e2017069-2aa6-4cd0-b12f-16af7887b48b/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Start _get_guest_xml network_info=[{"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGdBbvVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2017069-2aa6-4cd0-b12f-16af7887b48b', 'attached_at': '', 'detached_at': '', 'volume_id': '99f5ea2f-fb71-4a59-b30b-8087d20eda29', 'serial': '99f5ea2f-fb71-4a59-b30b-8087d20eda29'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '0bd08146-18ed-47b1-a479-e4eef11da4f1', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDrLjlUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2017069-2aa6-4cd0-b12f-16af7887b48b', 'attached_at': '', 'detached_at': '', 'volume_id': '0d8081d7-762e-42a3-9656-0fd0ebf7ac8a', 'serial': '0d8081d7-762e-42a3-9656-0fd0ebf7ac8a'}, 'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '00cb30cc-434c-4ecd-ab87-33ee5b26218e', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erFBlGQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2017069-2aa6-4cd0-b12f-16af7887b48b', 'attached_at': '', 'detached_at': '', 'volume_id': 'd51b32a3-b7e5-41de-b018-2e1120de2f08', 'serial': 'd51b32a3-b7e5-41de-b018-2e1120de2f08'}, 'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '81453e66-7cad-4fed-a65b-4ef232feb9f5', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:11:17 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:11:17 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGdBbvVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:11:17 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:11:17 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:11:17 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd89e16e-f46c-4b9f-8119-bee960b4e65b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:11:17 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc8e2a-a5b1-477a-898d-82abd0111512]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29] added
Aug 14 12:11:17 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be12a22-0201-4c21-a1ca-133b0b6bbecc]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f797f726-140d-4cad-b7ae-88512df13fe3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGdBbvVs {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGdBbvVs" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee07b91f-0f33-43cf-a093-4ac6ac62129d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YGdBbvVs'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca057fe7-11a6-4f41-a525-0bd80cdc2c29]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c337336-2866-461d-b2f0-6cc5d0fa427f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:17 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:17 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c93c73f-89b5-4663-8de5-114f2d8a615f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29, portal: 172.16.0.220,3260]
Aug 14 12:11:17 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29, portal: 172.16.0.220,3260] successful.
Aug 14 12:11:17 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb69ed2b-ec34-4b86-b1a6-7dea2a54c74e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda9e226-5fd5-4cd9-a052-007af33a88e0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:17 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:17 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:17 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:17 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce18619f-6a23-4a34-a44a-ec6cd91bec3b]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:11:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGdBbvVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23063366633653966', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063366633653966', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDrLjlUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:11:18 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:11:18 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:11:18 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a560731-466e-4954-90de-4fac0bd21b16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:11:18 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[367ed981-9e41-4e8d-b0f5-00009a4313ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a] added
Aug 14 12:11:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1c758-f9ae-4c0e-b450-136a5f1564b6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e15ae8-8728-4dd2-b686-04d69f307ed7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vDrLjlUa {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vDrLjlUa" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[422e7fd3-fd98-4360-9c3d-ac0394232f36]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vDrLjlUa'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14eb46e-b82d-4ec8-86c9-e2938a677b5e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd15533-6f2e-476b-9457-2ede8008628c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:19 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:19 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:19 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:19 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c56b56c-eb3e-4693-88bc-dff61bb91fb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a, portal: 172.16.0.220,3260]
Aug 14 12:11:19 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a, portal: 172.16.0.220,3260] successful.
Aug 14 12:11:19 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6da2e0-0a4f-43cf-b07a-4da24c82c462]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baff3df-8437-4af2-9bf1-e1c4625449b5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:19 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:19 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:11:19 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:19 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:19 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:11:19 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a165557-5991-4fad-b360-6f26eee11096]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDrLjlUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23931323731646632', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931323731646632', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erFBlGQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:11:20 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:11:20 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:11:20 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b1fdf1-667c-4f9e-a7af-e1eb65fb948d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:11:20 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc21acf-813e-46c0-94ca-0bfdcccd0e7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08] added
Aug 14 12:11:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ef5d59-aaf6-4fe7-be39-b6b8331855a0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c55edce-fae2-4d47-ae86-34a099fbedb6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v erFBlGQM {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v erFBlGQM" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4090951-e3b5-4a4e-9a4e-5bcf4bef3ea9]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'erFBlGQM'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[827007cb-e665-4d5f-81c8-b7d73acd9712]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9980b1-3089-4b8c-84fd-7b2db0b583e7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:11:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:11:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e4e773-0439-4b47-adf4-c370173979ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08, portal: 172.16.0.220,3260]
Aug 14 12:11:20 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08, portal: 172.16.0.220,3260] successful.
Aug 14 12:11:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c575cfe5-6280-4131-a399-98d1ad4896e7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6298ced5-6e30-4728-b6e9-241356ce35db]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:11:20 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:11:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e9ebe-ac0f-4655-ac21-19ae13bd0a9d]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:11:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erFBlGQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "61e2212e-e26a-4065-b6f2-9801b2353f62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:21 user nova-compute[73012]: INFO nova.compute.manager [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Terminating instance
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.compute.manager [req-dd764b9c-29c1-453b-8efd-6e113ed047bb req-741acdc6-76ef-4a88-9cc5-082be16d8684 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received event network-vif-unplugged-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dd764b9c-29c1-453b-8efd-6e113ed047bb req-741acdc6-76ef-4a88-9cc5-082be16d8684 service nova] Acquiring lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dd764b9c-29c1-453b-8efd-6e113ed047bb req-741acdc6-76ef-4a88-9cc5-082be16d8684 service nova] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dd764b9c-29c1-453b-8efd-6e113ed047bb req-741acdc6-76ef-4a88-9cc5-082be16d8684 service nova] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.compute.manager [req-dd764b9c-29c1-453b-8efd-6e113ed047bb req-741acdc6-76ef-4a88-9cc5-082be16d8684 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] No waiting events found dispatching network-vif-unplugged-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.compute.manager [req-dd764b9c-29c1-453b-8efd-6e113ed047bb req-741acdc6-76ef-4a88-9cc5-082be16d8684 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received event network-vif-unplugged-d0978944-aac2-4942-843b-c0b5904ee117 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26234626335383039', 'path': '/dev/sde'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234626335383039', 'path': '/dev/sde'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:f5:72,bridge_name='br-int',has_traffic_filtering=True,id=5e30ee37-0c0f-48b1-8719-f949bcf47c10,network=Network(674aed60-730e-4e10-a46b-ac3b156cd2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e30ee37-0c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:07:6c,bridge_name='br-int',has_traffic_filtering=True,id=94f3ff54-1015-4d97-a5d8-1700aa55cd98,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94f3ff54-10') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ee:bc,bridge_name='br-int',has_traffic_filtering=True,id=ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped0b4a4d-6d') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:91,bridge_name='br-int',has_traffic_filtering=True,id=1e22b2f7-3b42-40bd-9cf5-c64e63eeb001,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22b2f7-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:6d:13,bridge_name='br-int',has_traffic_filtering=True,id=63039d69-9348-496a-9acc-7a527f14c14d,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63039d69-93') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d8:0b,bridge_name='br-int',has_traffic_filtering=True,id=78c215c5-4cf9-407c-8f72-927553c1b299,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c215c5-4c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=f1f01a68-a0eb-4d18-8d8d-80097ae41d56,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f01a68-a0') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lazy-loading 'pci_devices' on Instance uuid e2017069-2aa6-4cd0-b12f-16af7887b48b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:11:21 user nova-compute[73012]:   <uuid>e2017069-2aa6-4cd0-b12f-16af7887b48b</uuid>
Aug 14 12:11:21 user nova-compute[73012]:   <name>instance-00000012</name>
Aug 14 12:11:21 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:11:21 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:11:21 user nova-compute[73012]:   <metadata>
Aug 14 12:11:21 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:11:21 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:11:21 user nova-compute[73012]:       <nova:name>tempest-device-tagging-server-1662986421</nova:name>
Aug 14 12:11:21 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:11:17</nova:creationTime>
Aug 14 12:11:21 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:11:21 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:11:21 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:11:21 user nova-compute[73012]:       <nova:owner>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:user uuid="df4acd9a2410441795c6a397946130cd">tempest-TaggedBootDevicesTest_v242-2061817737-project-member</nova:user>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:project uuid="5e0f9d241b964ed3a36a9bb4b590ef6a">tempest-TaggedBootDevicesTest_v242-2061817737</nova:project>
Aug 14 12:11:21 user nova-compute[73012]:       </nova:owner>
Aug 14 12:11:21 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:11:21 user nova-compute[73012]:       <nova:ports>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:port uuid="5e30ee37-0c0f-48b1-8719-f949bcf47c10">
Aug 14 12:11:21 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 12:11:21 user nova-compute[73012]:         </nova:port>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:port uuid="94f3ff54-1015-4d97-a5d8-1700aa55cd98">
Aug 14 12:11:21 user nova-compute[73012]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Aug 14 12:11:21 user nova-compute[73012]:         </nova:port>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:port uuid="ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019">
Aug 14 12:11:21 user nova-compute[73012]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Aug 14 12:11:21 user nova-compute[73012]:         </nova:port>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:port uuid="1e22b2f7-3b42-40bd-9cf5-c64e63eeb001">
Aug 14 12:11:21 user nova-compute[73012]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Aug 14 12:11:21 user nova-compute[73012]:         </nova:port>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:port uuid="63039d69-9348-496a-9acc-7a527f14c14d">
Aug 14 12:11:21 user nova-compute[73012]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Aug 14 12:11:21 user nova-compute[73012]:         </nova:port>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:port uuid="78c215c5-4cf9-407c-8f72-927553c1b299">
Aug 14 12:11:21 user nova-compute[73012]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 12:11:21 user nova-compute[73012]:         </nova:port>
Aug 14 12:11:21 user nova-compute[73012]:         <nova:port uuid="f1f01a68-a0eb-4d18-8d8d-80097ae41d56">
Aug 14 12:11:21 user nova-compute[73012]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 12:11:21 user nova-compute[73012]:         </nova:port>
Aug 14 12:11:21 user nova-compute[73012]:       </nova:ports>
Aug 14 12:11:21 user nova-compute[73012]:     </nova:instance>
Aug 14 12:11:21 user nova-compute[73012]:   </metadata>
Aug 14 12:11:21 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:11:21 user nova-compute[73012]:     <system>
Aug 14 12:11:21 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:11:21 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:11:21 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:11:21 user nova-compute[73012]:       <entry name="serial">e2017069-2aa6-4cd0-b12f-16af7887b48b</entry>
Aug 14 12:11:21 user nova-compute[73012]:       <entry name="uuid">e2017069-2aa6-4cd0-b12f-16af7887b48b</entry>
Aug 14 12:11:21 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:11:21 user nova-compute[73012]:     </system>
Aug 14 12:11:21 user nova-compute[73012]:   </sysinfo>
Aug 14 12:11:21 user nova-compute[73012]:   <os>
Aug 14 12:11:21 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:11:21 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:11:21 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:11:21 user nova-compute[73012]:   </os>
Aug 14 12:11:21 user nova-compute[73012]:   <features>
Aug 14 12:11:21 user nova-compute[73012]:     <acpi/>
Aug 14 12:11:21 user nova-compute[73012]:     <apic/>
Aug 14 12:11:21 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:11:21 user nova-compute[73012]:   </features>
Aug 14 12:11:21 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:11:21 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:11:21 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:11:21 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:11:21 user nova-compute[73012]:   </clock>
Aug 14 12:11:21 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:11:21 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:11:21 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:11:21 user nova-compute[73012]:   </cpu>
Aug 14 12:11:21 user nova-compute[73012]:   <devices>
Aug 14 12:11:21 user nova-compute[73012]:     <disk type="file" device="cdrom">
Aug 14 12:11:21 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 12:11:21 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/e2017069-2aa6-4cd0-b12f-16af7887b48b/disk.config"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="hda" bus="ide"/>
Aug 14 12:11:21 user nova-compute[73012]:     </disk>
Aug 14 12:11:21 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:11:21 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:11:21 user nova-compute[73012]:       <source dev="/dev/sdc"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <serial>99f5ea2f-fb71-4a59-b30b-8087d20eda29</serial>
Aug 14 12:11:21 user nova-compute[73012]:     </disk>
Aug 14 12:11:21 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:11:21 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:11:21 user nova-compute[73012]:       <source dev="/dev/sdd"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <serial>0d8081d7-762e-42a3-9656-0fd0ebf7ac8a</serial>
Aug 14 12:11:21 user nova-compute[73012]:     </disk>
Aug 14 12:11:21 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:11:21 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:11:21 user nova-compute[73012]:       <source dev="/dev/sde"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="vdc" bus="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <serial>d51b32a3-b7e5-41de-b018-2e1120de2f08</serial>
Aug 14 12:11:21 user nova-compute[73012]:     </disk>
Aug 14 12:11:21 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:11:21 user nova-compute[73012]:       <mac address="fa:16:3e:78:f5:72"/>
Aug 14 12:11:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="tap5e30ee37-0c"/>
Aug 14 12:11:21 user nova-compute[73012]:     </interface>
Aug 14 12:11:21 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:11:21 user nova-compute[73012]:       <mac address="fa:16:3e:c4:07:6c"/>
Aug 14 12:11:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="tap94f3ff54-10"/>
Aug 14 12:11:21 user nova-compute[73012]:     </interface>
Aug 14 12:11:21 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:11:21 user nova-compute[73012]:       <mac address="fa:16:3e:c6:ee:bc"/>
Aug 14 12:11:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="taped0b4a4d-6d"/>
Aug 14 12:11:21 user nova-compute[73012]:     </interface>
Aug 14 12:11:21 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:11:21 user nova-compute[73012]:       <mac address="fa:16:3e:75:e6:91"/>
Aug 14 12:11:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="tap1e22b2f7-3b"/>
Aug 14 12:11:21 user nova-compute[73012]:     </interface>
Aug 14 12:11:21 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:11:21 user nova-compute[73012]:       <mac address="fa:16:3e:97:6d:13"/>
Aug 14 12:11:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="tap63039d69-93"/>
Aug 14 12:11:21 user nova-compute[73012]:     </interface>
Aug 14 12:11:21 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:11:21 user nova-compute[73012]:       <mac address="fa:16:3e:44:d8:0b"/>
Aug 14 12:11:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="tap78c215c5-4c"/>
Aug 14 12:11:21 user nova-compute[73012]:     </interface>
Aug 14 12:11:21 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:11:21 user nova-compute[73012]:       <mac address="fa:16:3e:61:27:4c"/>
Aug 14 12:11:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:11:21 user nova-compute[73012]:       <target dev="tapf1f01a68-a0"/>
Aug 14 12:11:21 user nova-compute[73012]:     </interface>
Aug 14 12:11:21 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:11:21 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/e2017069-2aa6-4cd0-b12f-16af7887b48b/console.log" append="off"/>
Aug 14 12:11:21 user nova-compute[73012]:     </serial>
Aug 14 12:11:21 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:11:21 user nova-compute[73012]:     <video>
Aug 14 12:11:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:11:21 user nova-compute[73012]:     </video>
Aug 14 12:11:21 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:11:21 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:11:21 user nova-compute[73012]:     </rng>
Aug 14 12:11:21 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:11:21 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:11:21 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:11:21 user nova-compute[73012]:     </memballoon>
Aug 14 12:11:21 user nova-compute[73012]:   </devices>
Aug 14 12:11:21 user nova-compute[73012]: </domain>
Aug 14 12:11:21 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:f5:72,bridge_name='br-int',has_traffic_filtering=True,id=5e30ee37-0c0f-48b1-8719-f949bcf47c10,network=Network(674aed60-730e-4e10-a46b-ac3b156cd2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e30ee37-0c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:f5:72,bridge_name='br-int',has_traffic_filtering=True,id=5e30ee37-0c0f-48b1-8719-f949bcf47c10,network=Network(674aed60-730e-4e10-a46b-ac3b156cd2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e30ee37-0c') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e30ee37-0c, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e30ee37-0c, col_values=(('external_ids', {'iface-id': '5e30ee37-0c0f-48b1-8719-f949bcf47c10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:f5:72', 'vm-uuid': 'e2017069-2aa6-4cd0-b12f-16af7887b48b'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: INFO os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:f5:72,bridge_name='br-int',has_traffic_filtering=True,id=5e30ee37-0c0f-48b1-8719-f949bcf47c10,network=Network(674aed60-730e-4e10-a46b-ac3b156cd2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e30ee37-0c')
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:07:6c,bridge_name='br-int',has_traffic_filtering=True,id=94f3ff54-1015-4d97-a5d8-1700aa55cd98,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94f3ff54-10') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:07:6c,bridge_name='br-int',has_traffic_filtering=True,id=94f3ff54-1015-4d97-a5d8-1700aa55cd98,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94f3ff54-10') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94f3ff54-10, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94f3ff54-10, col_values=(('external_ids', {'iface-id': '94f3ff54-1015-4d97-a5d8-1700aa55cd98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:07:6c', 'vm-uuid': 'e2017069-2aa6-4cd0-b12f-16af7887b48b'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: INFO os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:07:6c,bridge_name='br-int',has_traffic_filtering=True,id=94f3ff54-1015-4d97-a5d8-1700aa55cd98,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94f3ff54-10')
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ee:bc,bridge_name='br-int',has_traffic_filtering=True,id=ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped0b4a4d-6d') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ee:bc,bridge_name='br-int',has_traffic_filtering=True,id=ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped0b4a4d-6d') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped0b4a4d-6d, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped0b4a4d-6d, col_values=(('external_ids', {'iface-id': 'ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:ee:bc', 'vm-uuid': 'e2017069-2aa6-4cd0-b12f-16af7887b48b'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: INFO os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ee:bc,bridge_name='br-int',has_traffic_filtering=True,id=ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped0b4a4d-6d')
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:91,bridge_name='br-int',has_traffic_filtering=True,id=1e22b2f7-3b42-40bd-9cf5-c64e63eeb001,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22b2f7-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:91,bridge_name='br-int',has_traffic_filtering=True,id=1e22b2f7-3b42-40bd-9cf5-c64e63eeb001,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22b2f7-3b') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e22b2f7-3b, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e22b2f7-3b, col_values=(('external_ids', {'iface-id': '1e22b2f7-3b42-40bd-9cf5-c64e63eeb001', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:e6:91', 'vm-uuid': 'e2017069-2aa6-4cd0-b12f-16af7887b48b'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: INFO os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:91,bridge_name='br-int',has_traffic_filtering=True,id=1e22b2f7-3b42-40bd-9cf5-c64e63eeb001,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22b2f7-3b')
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:6d:13,bridge_name='br-int',has_traffic_filtering=True,id=63039d69-9348-496a-9acc-7a527f14c14d,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63039d69-93') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:6d:13,bridge_name='br-int',has_traffic_filtering=True,id=63039d69-9348-496a-9acc-7a527f14c14d,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63039d69-93') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63039d69-93, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63039d69-93, col_values=(('external_ids', {'iface-id': '63039d69-9348-496a-9acc-7a527f14c14d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:6d:13', 'vm-uuid': 'e2017069-2aa6-4cd0-b12f-16af7887b48b'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: INFO os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:6d:13,bridge_name='br-int',has_traffic_filtering=True,id=63039d69-9348-496a-9acc-7a527f14c14d,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63039d69-93')
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d8:0b,bridge_name='br-int',has_traffic_filtering=True,id=78c215c5-4cf9-407c-8f72-927553c1b299,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c215c5-4c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d8:0b,bridge_name='br-int',has_traffic_filtering=True,id=78c215c5-4cf9-407c-8f72-927553c1b299,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c215c5-4c') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78c215c5-4c, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78c215c5-4c, col_values=(('external_ids', {'iface-id': '78c215c5-4cf9-407c-8f72-927553c1b299', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:d8:0b', 'vm-uuid': 'e2017069-2aa6-4cd0-b12f-16af7887b48b'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:11:22 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Instance destroyed successfully.
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.objects.instance [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lazy-loading 'resources' on Instance uuid 61e2212e-e26a-4065-b6f2-9801b2353f62 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-903219396',display_name='tempest-VolumesActionsTest-instance-903219396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-903219396',id=16,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5abf0cec2b9b4977ba86d806058ec6df',ramdisk_id='',reservation_id='r-wg6puvlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-793579565',owner_user_name='tempest-VolumesActionsTest-793579565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:09:45Z,user_data=None,user_id='a52866e21ac4407eb3004b69a38ce75b',uuid=61e2212e-e26a-4065-b6f2-9801b2353f62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converting VIF {"id": "d0978944-aac2-4942-843b-c0b5904ee117", "address": "fa:16:3e:41:e3:1b", "network": {"id": "e26b2e0e-cb23-49c2-a51e-b9f4135305f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1484862110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5abf0cec2b9b4977ba86d806058ec6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0978944-aa", "ovs_interfaceid": "d0978944-aac2-4942-843b-c0b5904ee117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=d0978944-aac2-4942-843b-c0b5904ee117,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0978944-aa') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG os_vif [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=d0978944-aac2-4942-843b-c0b5904ee117,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0978944-aa') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:22 user nova-compute[73012]: INFO os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d8:0b,bridge_name='br-int',has_traffic_filtering=True,id=78c215c5-4cf9-407c-8f72-927553c1b299,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c215c5-4c')
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=f1f01a68-a0eb-4d18-8d8d-80097ae41d56,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f01a68-a0') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=f1f01a68-a0eb-4d18-8d8d-80097ae41d56,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f01a68-a0') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0978944-aa, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:11:22 user nova-compute[73012]: INFO os_vif [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e3:1b,bridge_name='br-int',has_traffic_filtering=True,id=d0978944-aac2-4942-843b-c0b5904ee117,network=Network(e26b2e0e-cb23-49c2-a51e-b9f4135305f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0978944-aa')
Aug 14 12:11:22 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Deleting instance files /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62_del
Aug 14 12:11:22 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Deletion of /opt/stack/data/nova/instances/61e2212e-e26a-4065-b6f2-9801b2353f62_del complete
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1f01a68-a0, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1f01a68-a0, col_values=(('external_ids', {'iface-id': 'f1f01a68-a0eb-4d18-8d8d-80097ae41d56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:27:4c', 'vm-uuid': 'e2017069-2aa6-4cd0-b12f-16af7887b48b'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:22 user nova-compute[73012]: INFO os_vif [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=f1f01a68-a0eb-4d18-8d8d-80097ae41d56,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f01a68-a0')
Aug 14 12:11:22 user nova-compute[73012]: INFO nova.compute.manager [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 14 12:11:22 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] No BDM found with device name hda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] No VIF found with MAC fa:16:3e:78:f5:72, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] No VIF found with MAC fa:16:3e:97:6d:13, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:11:22 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Using config drive
Aug 14 12:11:22 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Creating config drive at /opt/stack/data/nova/instances/e2017069-2aa6-4cd0-b12f-16af7887b48b/disk.config
Aug 14 12:11:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2017069-2aa6-4cd0-b12f-16af7887b48b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6ng85x49 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2017069-2aa6-4cd0-b12f-16af7887b48b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6ng85x49" returned: 0 in 0.069s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-085cf803-afbe-4c5e-bec9-c6fb600f4a63 req-864f9584-1f4b-48c4-a9f4-2ce6a43e95e8 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received event network-vif-deleted-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:22 user nova-compute[73012]: INFO nova.compute.manager [req-085cf803-afbe-4c5e-bec9-c6fb600f4a63 req-864f9584-1f4b-48c4-a9f4-2ce6a43e95e8 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Neutron deleted interface d0978944-aac2-4942-843b-c0b5904ee117; detaching it from the instance and deleting it from the info cache
Aug 14 12:11:22 user nova-compute[73012]: DEBUG nova.network.neutron [req-085cf803-afbe-4c5e-bec9-c6fb600f4a63 req-864f9584-1f4b-48c4-a9f4-2ce6a43e95e8 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:22 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Took 0.67 seconds to deallocate network for instance.
Aug 14 12:11:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-085cf803-afbe-4c5e-bec9-c6fb600f4a63 req-864f9584-1f4b-48c4-a9f4-2ce6a43e95e8 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Detach interface failed, port_id=d0978944-aac2-4942-843b-c0b5904ee117, reason: Instance 61e2212e-e26a-4065-b6f2-9801b2353f62 could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:23 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Deleted allocations for instance 61e2212e-e26a-4065-b6f2-9801b2353f62
Aug 14 12:11:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4ea55869-010d-4a1b-abc7-68bb49d9cfa9 tempest-VolumesActionsTest-793579565 tempest-VolumesActionsTest-793579565-project-member] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-35ee9f6f-35d6-473e-81a7-e79626ff1fe6 req-58a8f4b4-2e7d-4b35-8dff-0e46f0a04670 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received event network-vif-plugged-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-35ee9f6f-35d6-473e-81a7-e79626ff1fe6 req-58a8f4b4-2e7d-4b35-8dff-0e46f0a04670 service nova] Acquiring lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-35ee9f6f-35d6-473e-81a7-e79626ff1fe6 req-58a8f4b4-2e7d-4b35-8dff-0e46f0a04670 service nova] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-35ee9f6f-35d6-473e-81a7-e79626ff1fe6 req-58a8f4b4-2e7d-4b35-8dff-0e46f0a04670 service nova] Lock "61e2212e-e26a-4065-b6f2-9801b2353f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-35ee9f6f-35d6-473e-81a7-e79626ff1fe6 req-58a8f4b4-2e7d-4b35-8dff-0e46f0a04670 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] No waiting events found dispatching network-vif-plugged-d0978944-aac2-4942-843b-c0b5904ee117 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:23 user nova-compute[73012]: WARNING nova.compute.manager [req-35ee9f6f-35d6-473e-81a7-e79626ff1fe6 req-58a8f4b4-2e7d-4b35-8dff-0e46f0a04670 service nova] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Received unexpected event network-vif-plugged-d0978944-aac2-4942-843b-c0b5904ee117 for instance with vm_state deleted and task_state None.
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: INFO nova.compute.manager [None req-d11b561f-806e-44ab-bfd9-6e16f93dc511 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Unrescuing
Aug 14 12:11:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d11b561f-806e-44ab-bfd9-6e16f93dc511 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d11b561f-806e-44ab-bfd9-6e16f93dc511 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquired lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d11b561f-806e-44ab-bfd9-6e16f93dc511 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-77489e22-2dd1-4df5-b9e6-3bf50c0daebd req-44e4d48f-d637-4a5e-bfaf-04b7d83dab2d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-77489e22-2dd1-4df5-b9e6-3bf50c0daebd req-44e4d48f-d637-4a5e-bfaf-04b7d83dab2d service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-77489e22-2dd1-4df5-b9e6-3bf50c0daebd req-44e4d48f-d637-4a5e-bfaf-04b7d83dab2d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-77489e22-2dd1-4df5-b9e6-3bf50c0daebd req-44e4d48f-d637-4a5e-bfaf-04b7d83dab2d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-77489e22-2dd1-4df5-b9e6-3bf50c0daebd req-44e4d48f-d637-4a5e-bfaf-04b7d83dab2d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:24 user nova-compute[73012]: WARNING nova.compute.manager [req-77489e22-2dd1-4df5-b9e6-3bf50c0daebd req-44e4d48f-d637-4a5e-bfaf-04b7d83dab2d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 for instance with vm_state building and task_state spawning.
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:25 user nova-compute[73012]: WARNING nova.compute.manager [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 for instance with vm_state building and task_state spawning.
Aug 14 12:11:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:25 user nova-compute[73012]: WARNING nova.compute.manager [req-5320c872-4397-4c48-98a6-12179fed56eb req-1049c73e-7db9-4943-91cf-44b5fcc93776 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 for instance with vm_state building and task_state spawning.
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d11b561f-806e-44ab-bfd9-6e16f93dc511 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d11b561f-806e-44ab-bfd9-6e16f93dc511 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Releasing lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d11b561f-806e-44ab-bfd9-6e16f93dc511 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'flavor' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-ecb82b37-f620-4fd9-bc45-1fa1d66409d2 req-dad1c8fc-8eb0-41fb-8d66-e29a1f3bb017 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecb82b37-f620-4fd9-bc45-1fa1d66409d2 req-dad1c8fc-8eb0-41fb-8d66-e29a1f3bb017 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecb82b37-f620-4fd9-bc45-1fa1d66409d2 req-dad1c8fc-8eb0-41fb-8d66-e29a1f3bb017 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecb82b37-f620-4fd9-bc45-1fa1d66409d2 req-dad1c8fc-8eb0-41fb-8d66-e29a1f3bb017 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-ecb82b37-f620-4fd9-bc45-1fa1d66409d2 req-dad1c8fc-8eb0-41fb-8d66-e29a1f3bb017 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:26 user nova-compute[73012]: WARNING nova.compute.manager [req-ecb82b37-f620-4fd9-bc45-1fa1d66409d2 req-dad1c8fc-8eb0-41fb-8d66-e29a1f3bb017 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-78c215c5-4cf9-407c-8f72-927553c1b299 for instance with vm_state building and task_state spawning.
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Instance destroyed successfully.
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:27 user nova-compute[73012]: WARNING nova.compute.manager [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 for instance with vm_state building and task_state spawning.
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:27 user nova-compute[73012]: WARNING nova.compute.manager [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 for instance with vm_state building and task_state spawning.
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:27 user nova-compute[73012]: WARNING nova.compute.manager [req-2359728f-2912-4f5b-924f-9775fdf4966b req-bf1be34f-a3f9-4d27-af1c-6be1fac9612f service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 for instance with vm_state building and task_state spawning.
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:27 user nova-compute[73012]: WARNING nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-63039d69-9348-496a-9acc-7a527f14c14d for instance with vm_state building and task_state spawning.
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:27 user nova-compute[73012]: WARNING nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-63039d69-9348-496a-9acc-7a527f14c14d for instance with vm_state building and task_state spawning.
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-unplugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-unplugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:27 user nova-compute[73012]: WARNING nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-unplugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:27 user nova-compute[73012]: WARNING nova.compute.manager [req-816411d7-e03d-4c0e-8f6a-583fe3e0e376 req-69c00842-11fd-4765-ae05-54ca80e2c0e0 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:11:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:28 user nova-compute[73012]: WARNING nova.compute.manager [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-78c215c5-4cf9-407c-8f72-927553c1b299 for instance with vm_state building and task_state spawning.
Aug 14 12:11:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:28 user nova-compute[73012]: WARNING nova.compute.manager [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 for instance with vm_state building and task_state spawning.
Aug 14 12:11:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:28 user nova-compute[73012]: WARNING nova.compute.manager [req-7d264177-6be0-436f-a994-2b55050d0a38 req-7d4f2838-77e6-42e5-a201-0030efd6fd17 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 for instance with vm_state building and task_state spawning.
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:28 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-changed-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Refreshing instance network info cache due to event network-changed-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Acquiring lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Acquired lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.network.neutron [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Refreshing network info cache for port decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-364d50d9-0993-4d9b-a792-6849a905c4d0 req-232c1218-afb7-4537-b0a9-9b6793d86672 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-364d50d9-0993-4d9b-a792-6849a905c4d0 req-232c1218-afb7-4537-b0a9-9b6793d86672 service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-364d50d9-0993-4d9b-a792-6849a905c4d0 req-232c1218-afb7-4537-b0a9-9b6793d86672 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-364d50d9-0993-4d9b-a792-6849a905c4d0 req-232c1218-afb7-4537-b0a9-9b6793d86672 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-364d50d9-0993-4d9b-a792-6849a905c4d0 req-232c1218-afb7-4537-b0a9-9b6793d86672 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:29 user nova-compute[73012]: WARNING nova.compute.manager [req-364d50d9-0993-4d9b-a792-6849a905c4d0 req-232c1218-afb7-4537-b0a9-9b6793d86672 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.network.neutron [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updated VIF entry in instance network info cache for port decbb2a3-6f5c-48e3-a1ef-ee8237584aeb. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.network.neutron [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Releasing lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-changed-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Refreshing instance network info cache due to event network-changed-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Acquiring lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Acquired lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:29 user nova-compute[73012]: DEBUG nova.network.neutron [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Refreshing network info cache for port decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015090.1232533, e2017069-2aa6-4cd0-b12f-16af7887b48b => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] VM Resumed (Lifecycle Event)
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance spawned successfully.
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015090.124649, e2017069-2aa6-4cd0-b12f-16af7887b48b => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] VM Started (Lifecycle Event)
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Took 12.93 seconds to spawn the instance on the hypervisor.
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.compute.manager [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Took 43.34 seconds to build instance.
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3f331fd1-afde-4d51-a21b-e734afa08b2b tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.488s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.network.neutron [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updated VIF entry in instance network info cache for port decbb2a3-6f5c-48e3-a1ef-ee8237584aeb. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.network.neutron [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Releasing lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:30 user nova-compute[73012]: WARNING nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 for instance with vm_state building and task_state spawning.
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:30 user nova-compute[73012]: WARNING nova.compute.manager [req-5188ceeb-159f-45fd-9b43-593afd5076de req-83178799-42e0-48f2-8d84-c98e69d417b2 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 for instance with vm_state building and task_state spawning.
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for 0d678d6a-ace6-4bcc-82af-29460c7c50cb due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015090.810583, 0d678d6a-ace6-4bcc-82af-29460c7c50cb => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] VM Resumed (Lifecycle Event)
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d11b561f-806e-44ab-bfd9-6e16f93dc511 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015090.8114083, 0d678d6a-ace6-4bcc-82af-29460c7c50cb => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:11:30 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] VM Started (Lifecycle Event)
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-65e93539-c223-4b96-b3c4-b4a635e53fbc req-a4d5f1c8-c05d-42f1-b4e9-cba384ab5786 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-65e93539-c223-4b96-b3c4-b4a635e53fbc req-a4d5f1c8-c05d-42f1-b4e9-cba384ab5786 service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-65e93539-c223-4b96-b3c4-b4a635e53fbc req-a4d5f1c8-c05d-42f1-b4e9-cba384ab5786 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-65e93539-c223-4b96-b3c4-b4a635e53fbc req-a4d5f1c8-c05d-42f1-b4e9-cba384ab5786 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-65e93539-c223-4b96-b3c4-b4a635e53fbc req-a4d5f1c8-c05d-42f1-b4e9-cba384ab5786 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:31 user nova-compute[73012]: WARNING nova.compute.manager [req-65e93539-c223-4b96-b3c4-b4a635e53fbc req-a4d5f1c8-c05d-42f1-b4e9-cba384ab5786 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state active and task_state None.
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:11:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:34 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:11:34 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7630MB free_disk=25.595703125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4c2979a7-addd-4746-be89-9e5cad4cae3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e2017069-2aa6-4cd0-b12f-16af7887b48b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:11:34 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:11:35 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:11:35 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:11:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.820s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:35 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:11:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:11:35 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:11:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [{"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-0d678d6a-ace6-4bcc-82af-29460c7c50cb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:11:37 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015082.0246148, 61e2212e-e26a-4065-b6f2-9801b2353f62 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:11:37 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] VM Stopped (Lifecycle Event)
Aug 14 12:11:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4a0e2375-da9e-4a62-b6b9-26854b525641 None None] [instance: 61e2212e-e26a-4065-b6f2-9801b2353f62] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:11:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:38 user nova-compute[73012]: DEBUG nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:11:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:11:38 user nova-compute[73012]: INFO nova.compute.claims [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Claim successful on node user
Aug 14 12:11:39 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:11:39 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:11:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:11:39 user nova-compute[73012]: INFO nova.virt.block_device [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Booting with volume fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd at /dev/vda
Aug 14 12:11:39 user nova-compute[73012]: DEBUG os_brick.utils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG nova.policy [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ee6d00a3d5342fa860cc3fcdf3b46aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61e73551aaed4aa6be678848f889f8c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[de664751-0ec6-4c3a-a2ae-6f80e1469479]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0cf82f-7ada-4442-8d84-eeb05acf2c90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3120cc2-9cba-4c80-b662-e8d7b1097037]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[19730d40-9707-4e4c-9e84-2f66fb6e5c0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:11:39 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:11:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ce7cea-e258-4051-97e1-faeb2f81490b]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG os_brick.utils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:11:39 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating existing volume attachment record: 56c7481a-25cd-491c-8b86-0a01b68fcf65 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:11:40 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully created port: 8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:11:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:40 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully created port: 01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:11:41 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully created port: ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:11:42 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully created port: 62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:11:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:42 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully created port: b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:11:43 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully updated port: 8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:11:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-5079b4cc-3583-4b82-90ff-02a4dfe2d1f7 req-609b7671-f4f2-4657-9763-1c717219e430 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-changed-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-5079b4cc-3583-4b82-90ff-02a4dfe2d1f7 req-609b7671-f4f2-4657-9763-1c717219e430 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing instance network info cache due to event network-changed-8f766834-3616-4cde-a637-1e69ea30b119. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5079b4cc-3583-4b82-90ff-02a4dfe2d1f7 req-609b7671-f4f2-4657-9763-1c717219e430 service nova] Acquiring lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5079b4cc-3583-4b82-90ff-02a4dfe2d1f7 req-609b7671-f4f2-4657-9763-1c717219e430 service nova] Acquired lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:43 user nova-compute[73012]: DEBUG nova.network.neutron [req-5079b4cc-3583-4b82-90ff-02a4dfe2d1f7 req-609b7671-f4f2-4657-9763-1c717219e430 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing network info cache for port 8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:43 user nova-compute[73012]: DEBUG nova.network.neutron [req-5079b4cc-3583-4b82-90ff-02a4dfe2d1f7 req-609b7671-f4f2-4657-9763-1c717219e430 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-5079b4cc-3583-4b82-90ff-02a4dfe2d1f7 req-609b7671-f4f2-4657-9763-1c717219e430 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5079b4cc-3583-4b82-90ff-02a4dfe2d1f7 req-609b7671-f4f2-4657-9763-1c717219e430 service nova] Releasing lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:44 user nova-compute[73012]: INFO nova.compute.manager [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Terminating instance
Aug 14 12:11:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully updated port: 0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-3d7eb6e7-f96a-41f5-8bbf-ed796d68d8d9 req-30ef3717-303c-455e-bd78-168e438afe98 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received event network-vif-unplugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3d7eb6e7-f96a-41f5-8bbf-ed796d68d8d9 req-30ef3717-303c-455e-bd78-168e438afe98 service nova] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3d7eb6e7-f96a-41f5-8bbf-ed796d68d8d9 req-30ef3717-303c-455e-bd78-168e438afe98 service nova] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3d7eb6e7-f96a-41f5-8bbf-ed796d68d8d9 req-30ef3717-303c-455e-bd78-168e438afe98 service nova] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-3d7eb6e7-f96a-41f5-8bbf-ed796d68d8d9 req-30ef3717-303c-455e-bd78-168e438afe98 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] No waiting events found dispatching network-vif-unplugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-3d7eb6e7-f96a-41f5-8bbf-ed796d68d8d9 req-30ef3717-303c-455e-bd78-168e438afe98 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received event network-vif-unplugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Instance destroyed successfully.
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lazy-loading 'resources' on Instance uuid 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1627210626',display_name='tempest-VolumesAdminNegativeTest-server-1627210626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1627210626',id=4,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWIffzF5gVW0jbmrX7gNyr9gakyCbZxb2hIaFq6WiapzdOBPKxKhqmI+OfbRW7LZqvcnW3b/NoPbCZZlhZavW2yx750mkRuF4NwfSDUqO0fg43A1YB/nMloRRcoaGpFoQ==',key_name='tempest-keypair-1825082147',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:05:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2210f703a6814803bcfb4266d264b0f5',ramdisk_id='',reservation_id='r-7o0ecef4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-384894799',owner_user_name='tempest-VolumesAdminNegativeTest-384894799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9442db73842a465493b2e020a0977cce',uuid=6df0ba9b-0c37-4e43-a6ef-8103c41f33f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converting VIF {"id": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "address": "fa:16:3e:79:4e:b2", "network": {"id": "5a81e72d-f23d-4f99-a597-0c941e576082", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-266520880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2210f703a6814803bcfb4266d264b0f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5e8f694-10", "ovs_interfaceid": "b5e8f694-10fa-4e20-9f7f-6f2336be289e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:4e:b2,bridge_name='br-int',has_traffic_filtering=True,id=b5e8f694-10fa-4e20-9f7f-6f2336be289e,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5e8f694-10') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG os_vif [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:4e:b2,bridge_name='br-int',has_traffic_filtering=True,id=b5e8f694-10fa-4e20-9f7f-6f2336be289e,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5e8f694-10') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5e8f694-10, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:11:45 user nova-compute[73012]: INFO os_vif [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:4e:b2,bridge_name='br-int',has_traffic_filtering=True,id=b5e8f694-10fa-4e20-9f7f-6f2336be289e,network=Network(5a81e72d-f23d-4f99-a597-0c941e576082),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5e8f694-10')
Aug 14 12:11:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Deleting instance files /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0_del
Aug 14 12:11:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Deletion of /opt/stack/data/nova/instances/6df0ba9b-0c37-4e43-a6ef-8103c41f33f0_del complete
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully updated port: 3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:11:45 user nova-compute[73012]: INFO nova.compute.manager [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 14 12:11:45 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-changed-0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing instance network info cache due to event network-changed-0e772e4c-640f-4440-83db-edd3ce27c7f8. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] Acquiring lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] Acquired lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.network.neutron [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing network info cache for port 0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.network.neutron [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:11:45 user nova-compute[73012]: DEBUG nova.network.neutron [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] Releasing lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:46 user nova-compute[73012]: DEBUG nova.compute.manager [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-changed-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:46 user nova-compute[73012]: DEBUG nova.compute.manager [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing instance network info cache due to event network-changed-3e2365da-a29b-45bf-bea0-5f20cb9a07e5. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] Acquiring lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] Acquired lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:46 user nova-compute[73012]: DEBUG nova.network.neutron [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing network info cache for port 3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:46 user nova-compute[73012]: DEBUG nova.network.neutron [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:11:46 user nova-compute[73012]: DEBUG nova.network.neutron [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-961cb9d3-07ab-4d37-9e25-1a8b61eaf909 req-887da771-c5f7-43e7-abe9-e02d2bd4ce2f service nova] Releasing lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-939c3347-b69c-499e-93ec-59fc711163ca req-c408bf2f-0af7-4647-b143-28ce996cf09d service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received event network-vif-plugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-939c3347-b69c-499e-93ec-59fc711163ca req-c408bf2f-0af7-4647-b143-28ce996cf09d service nova] Acquiring lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-939c3347-b69c-499e-93ec-59fc711163ca req-c408bf2f-0af7-4647-b143-28ce996cf09d service nova] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-939c3347-b69c-499e-93ec-59fc711163ca req-c408bf2f-0af7-4647-b143-28ce996cf09d service nova] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-939c3347-b69c-499e-93ec-59fc711163ca req-c408bf2f-0af7-4647-b143-28ce996cf09d service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] No waiting events found dispatching network-vif-plugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:11:47 user nova-compute[73012]: WARNING nova.compute.manager [req-939c3347-b69c-499e-93ec-59fc711163ca req-c408bf2f-0af7-4647-b143-28ce996cf09d service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received unexpected event network-vif-plugged-b5e8f694-10fa-4e20-9f7f-6f2336be289e for instance with vm_state active and task_state deleting.
Aug 14 12:11:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully updated port: 01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:11:47 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:47 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Took 2.00 seconds to deallocate network for instance.
Aug 14 12:11:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-a586066e-e022-4124-b220-bffa85f665be req-f2940fcc-61b0-4d83-9742-0373da262642 service nova] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Received event network-vif-deleted-b5e8f694-10fa-4e20-9f7f-6f2336be289e {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-a586066e-e022-4124-b220-bffa85f665be req-f2940fcc-61b0-4d83-9742-0373da262642 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-changed-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-a586066e-e022-4124-b220-bffa85f665be req-f2940fcc-61b0-4d83-9742-0373da262642 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing instance network info cache due to event network-changed-01f3ceea-f399-418f-a617-d60a5734079a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a586066e-e022-4124-b220-bffa85f665be req-f2940fcc-61b0-4d83-9742-0373da262642 service nova] Acquiring lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a586066e-e022-4124-b220-bffa85f665be req-f2940fcc-61b0-4d83-9742-0373da262642 service nova] Acquired lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG nova.network.neutron [req-a586066e-e022-4124-b220-bffa85f665be req-f2940fcc-61b0-4d83-9742-0373da262642 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing network info cache for port 01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG nova.network.neutron [req-a586066e-e022-4124-b220-bffa85f665be req-f2940fcc-61b0-4d83-9742-0373da262642 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:48 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Deleted allocations for instance 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0
Aug 14 12:11:48 user nova-compute[73012]: DEBUG nova.network.neutron [req-a586066e-e022-4124-b220-bffa85f665be req-f2940fcc-61b0-4d83-9742-0373da262642 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a586066e-e022-4124-b220-bffa85f665be req-f2940fcc-61b0-4d83-9742-0373da262642 service nova] Releasing lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60c164d5-6fdc-408e-a42a-8aae29431004 tempest-VolumesAdminNegativeTest-384894799 tempest-VolumesAdminNegativeTest-384894799-project-member] Lock "6df0ba9b-0c37-4e43-a6ef-8103c41f33f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.289s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully updated port: ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:11:49 user nova-compute[73012]: INFO nova.virt.block_device [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Booting with volume b338f7b3-8be1-454e-8f22-65baef92e40a at /dev/vdb
Aug 14 12:11:49 user nova-compute[73012]: DEBUG os_brick.utils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[692a5e60-2aa9-4c9c-af6d-12bfa7e6426a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[02da902c-ec09-4689-a5a1-622846d72fb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a047e40b-4e07-4a5c-a598-6691739d5c33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0a6216-3f36-4b5c-b3e2-4f70829b5db0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:11:50 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:11:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d262879-e00e-4b3e-b120-68dbb17dcee3]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG os_brick.utils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating existing volume attachment record: 58496c08-52d1-404d-99f5-077f9a515737 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully updated port: 62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-changed-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing instance network info cache due to event network-changed-ce2a4787-3b7d-490d-a9c2-65558de32504. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] Acquiring lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] Acquired lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing network info cache for port ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] Releasing lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-changed-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing instance network info cache due to event network-changed-62eac28e-c1d0-4be7-aa1b-550d0174481c. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] Acquiring lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] Acquired lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing network info cache for port 62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:11:51 user nova-compute[73012]: DEBUG nova.network.neutron [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3055e61a-b170-4a8c-89d3-f64dbf7acbbc req-9351bb19-1638-47b2-a632-baf2a763c32a service nova] Releasing lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Successfully updated port: b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:11:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquired lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:11:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:11:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-e4fc7736-e424-4bb7-81bd-1aa837233abf req-a795ef2e-1d7b-4374-958c-954e3e6933ee service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-changed-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:11:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-e4fc7736-e424-4bb7-81bd-1aa837233abf req-a795ef2e-1d7b-4374-958c-954e3e6933ee service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing instance network info cache due to event network-changed-b0ef7268-1dcf-47b3-893c-1401063d1c5c. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:11:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e4fc7736-e424-4bb7-81bd-1aa837233abf req-a795ef2e-1d7b-4374-958c-954e3e6933ee service nova] Acquiring lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:11:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [{"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Releasing lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance network_info: |[{"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:11:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e4fc7736-e424-4bb7-81bd-1aa837233abf req-a795ef2e-1d7b-4374-958c-954e3e6933ee service nova] Acquired lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:11:53 user nova-compute[73012]: DEBUG nova.network.neutron [req-e4fc7736-e424-4bb7-81bd-1aa837233abf req-a795ef2e-1d7b-4374-958c-954e3e6933ee service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing network info cache for port b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:11:54 user nova-compute[73012]: DEBUG nova.network.neutron [req-e4fc7736-e424-4bb7-81bd-1aa837233abf req-a795ef2e-1d7b-4374-958c-954e3e6933ee service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updated VIF entry in instance network info cache for port b0ef7268-1dcf-47b3-893c-1401063d1c5c. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:11:54 user nova-compute[73012]: DEBUG nova.network.neutron [req-e4fc7736-e424-4bb7-81bd-1aa837233abf req-a795ef2e-1d7b-4374-958c-954e3e6933ee service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [{"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:11:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e4fc7736-e424-4bb7-81bd-1aa837233abf req-a795ef2e-1d7b-4374-958c-954e3e6933ee service nova] Releasing lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:11:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:11:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:11:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:11:58 user nova-compute[73012]: INFO nova.compute.manager [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Detaching volume 788e399a-6264-44c5-95ed-b689ede0f853
Aug 14 12:11:58 user nova-compute[73012]: INFO nova.virt.block_device [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Attempting to driver detach volume 788e399a-6264-44c5-95ed-b689ede0f853 from mountpoint /dev/vdb
Aug 14 12:11:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Attempting to detach device vdb from instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:11:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:11:58 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:11:58 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:11:58 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:11:58 user nova-compute[73012]:   <serial>788e399a-6264-44c5-95ed-b689ede0f853</serial>
Aug 14 12:11:58 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:11:58 user nova-compute[73012]: </disk>
Aug 14 12:11:58 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:11:58 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Successfully detached device vdb from instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb from the persistent domain config.
Aug 14 12:11:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:11:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:11:58 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:11:58 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:11:58 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:11:58 user nova-compute[73012]:   <serial>788e399a-6264-44c5-95ed-b689ede0f853</serial>
Aug 14 12:11:58 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:11:58 user nova-compute[73012]: </disk>
Aug 14 12:11:58 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:11:59 user nova-compute[73012]: INFO nova.virt.block_device [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Booting with volume a72a74ef-560d-4e30-a9ce-8d809b5ed271 at /dev/vdc
Aug 14 12:11:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015119.4715157, 0d678d6a-ace6-4bcc-82af-29460c7c50cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:11:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Successfully detached device vdb from instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb from the live domain config.
Aug 14 12:11:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuvySNdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:11:59 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[627d872c-c3e2-4d15-948c-17d6fed5fe3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.utils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e442e8e0-c1c2-48ec-8272-8f730a3000d6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:59 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:59 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:11:59 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:11:59 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 (non-flash)
Aug 14 12:11:59 user nova-compute[73012]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:11:59 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:11:59 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:11:59 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0129090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c5a29-3034-4aa3-8412-9c018bc8752e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b37c529-82bc-49ea-af18-861eca145471]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca61a888-297c-4f26-b615-361d42c1095a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ff9636-41a8-4417-981d-dbb5af9c4447]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53ee957-af44-4604-953a-56322fcc5a65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[49369fea-7c25-4f29-b9d6-6784cbda5280]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8570b5ea-9315-483f-8c44-f2f65af0c7ac]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:11:59 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dac009-3c13-448a-af3e-696d985f564e]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.utils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating existing volume attachment record: e95aed7c-e99d-457c-9b08-03bca505ea59 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f79efa-a2b5-435a-b75b-8a357304440d]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9c19e5-71b9-429c-8852-91de8553e7f7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bb5782-057c-4afc-827e-585db3362709]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853, portal: 172.16.0.220,3260]
Aug 14 12:11:59 user nova-compute[73012]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853, portal: 172.16.0.220,3260] successful.
Aug 14 12:11:59 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788e399a-6264-44c5-95ed-b689ede0f853 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f803ee3a-2188-4680-a134-31a0f0bf3e55]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] <== disconnect_volume: return (359ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:11:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:12:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:00 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015105.3658628, 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:00 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] VM Stopped (Lifecycle Event)
Aug 14 12:12:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-97b54b1b-bb06-4569-8334-f3dcd7f55941 None None] [instance: 6df0ba9b-0c37-4e43-a6ef-8103c41f33f0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'flavor' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f2fba441-2ddf-4162-8ea0-8b225733a036 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.803s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:02 user nova-compute[73012]: INFO nova.compute.manager [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Terminating instance
Aug 14 12:12:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-0328c02a-83ad-4ae7-87e4-c34e3b0a9d5b req-9ca71016-3abf-436c-9ec1-849de9593c44 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-unplugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0328c02a-83ad-4ae7-87e4-c34e3b0a9d5b req-9ca71016-3abf-436c-9ec1-849de9593c44 service nova] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0328c02a-83ad-4ae7-87e4-c34e3b0a9d5b req-9ca71016-3abf-436c-9ec1-849de9593c44 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0328c02a-83ad-4ae7-87e4-c34e3b0a9d5b req-9ca71016-3abf-436c-9ec1-849de9593c44 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-0328c02a-83ad-4ae7-87e4-c34e3b0a9d5b req-9ca71016-3abf-436c-9ec1-849de9593c44 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] No waiting events found dispatching network-vif-unplugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-0328c02a-83ad-4ae7-87e4-c34e3b0a9d5b req-9ca71016-3abf-436c-9ec1-849de9593c44 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-unplugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:12:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Instance destroyed successfully.
Aug 14 12:12:03 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'resources' on Instance uuid 4c2979a7-addd-4746-be89-9e5cad4cae3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-504953000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-504953000',id=2,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWWx/ILh8Ns58c4RMDmnoFVw+ZxB5woQuR4Ai/Qbq5N2hQQNxo2Z4zYG11WGD0RkrLRIHbTYyq9giarhw3iS5T5OpyaaKY7mJ8oetC+zxpHsTL5Md9DwIWoSBSq3nhyQw==',key_name='tempest-keypair-2108541680',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:09:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-ie3t5afq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:09:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=4c2979a7-addd-4746-be89-9e5cad4cae3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "address": "fa:16:3e:84:74:b4", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32b1a3a-9a", "ovs_interfaceid": "b32b1a3a-9a4c-4d1d-a455-5d249794cb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG os_vif [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb32b1a3a-9a, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:03 user nova-compute[73012]: INFO os_vif [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:74:b4,bridge_name='br-int',has_traffic_filtering=True,id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32b1a3a-9a')
Aug 14 12:12:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Deleting instance files /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a_del
Aug 14 12:12:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Deletion of /opt/stack/data/nova/instances/4c2979a7-addd-4746-be89-9e5cad4cae3a_del complete
Aug 14 12:12:03 user nova-compute[73012]: INFO nova.compute.manager [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 14 12:12:03 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:12:03 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:12:04 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-5cb3f003-ec61-4192-8a0b-174682b313ff req-211f09a2-5533-4509-bac8-3c6c7766ad53 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-deleted-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:04 user nova-compute[73012]: INFO nova.compute.manager [req-5cb3f003-ec61-4192-8a0b-174682b313ff req-211f09a2-5533-4509-bac8-3c6c7766ad53 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Neutron deleted interface b32b1a3a-9a4c-4d1d-a455-5d249794cb62; detaching it from the instance and deleting it from the info cache
Aug 14 12:12:04 user nova-compute[73012]: DEBUG nova.network.neutron [req-5cb3f003-ec61-4192-8a0b-174682b313ff req-211f09a2-5533-4509-bac8-3c6c7766ad53 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:04 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Took 0.97 seconds to deallocate network for instance.
Aug 14 12:12:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-5cb3f003-ec61-4192-8a0b-174682b313ff req-211f09a2-5533-4509-bac8-3c6c7766ad53 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Detach interface failed, port_id=b32b1a3a-9a4c-4d1d-a455-5d249794cb62, reason: Instance 4c2979a7-addd-4746-be89-9e5cad4cae3a could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-85f49ead-ee50-4445-a479-4f879f045fad req-a6eb2e9c-0057-4ac9-a53f-7de60cb46070 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-85f49ead-ee50-4445-a479-4f879f045fad req-a6eb2e9c-0057-4ac9-a53f-7de60cb46070 service nova] Acquiring lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-85f49ead-ee50-4445-a479-4f879f045fad req-a6eb2e9c-0057-4ac9-a53f-7de60cb46070 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-85f49ead-ee50-4445-a479-4f879f045fad req-a6eb2e9c-0057-4ac9-a53f-7de60cb46070 service nova] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-85f49ead-ee50-4445-a479-4f879f045fad req-a6eb2e9c-0057-4ac9-a53f-7de60cb46070 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] No waiting events found dispatching network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:05 user nova-compute[73012]: WARNING nova.compute.manager [req-85f49ead-ee50-4445-a479-4f879f045fad req-a6eb2e9c-0057-4ac9-a53f-7de60cb46070 service nova] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Received unexpected event network-vif-plugged-b32b1a3a-9a4c-4d1d-a455-5d249794cb62 for instance with vm_state deleted and task_state None.
Aug 14 12:12:05 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:12:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:05 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Deleted allocations for instance 4c2979a7-addd-4746-be89-9e5cad4cae3a
Aug 14 12:12:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c3877263-fc5b-4cb4-90ae-a13edd79db5b tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "4c2979a7-addd-4746-be89-9e5cad4cae3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.681s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:12:09 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Creating image(s)
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Ensure instance console log exists: /opt/stack/data/nova/instances/427440ec-266a-41ab-b7e8-8d4f193d3671/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Start _get_guest_xml network_info=[{"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuysKqGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '427440ec-266a-41ab-b7e8-8d4f193d3671', 'attached_at': '', 'detached_at': '', 'volume_id': 'fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd', 'serial': 'fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '56c7481a-25cd-491c-8b86-0a01b68fcf65', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuGzyjAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '427440ec-266a-41ab-b7e8-8d4f193d3671', 'attached_at': '', 'detached_at': '', 'volume_id': 'b338f7b3-8be1-454e-8f22-65baef92e40a', 'serial': 'b338f7b3-8be1-454e-8f22-65baef92e40a'}, 'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '58496c08-52d1-404d-99f5-077f9a515737', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnayqOZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '427440ec-266a-41ab-b7e8-8d4f193d3671', 'attached_at': '', 'detached_at': '', 'volume_id': 'a72a74ef-560d-4e30-a9ce-8d809b5ed271', 'serial': 'a72a74ef-560d-4e30-a9ce-8d809b5ed271'}, 'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'e95aed7c-e99d-457c-9b08-03bca505ea59', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:12:09 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:09 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuysKqGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:12:09 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:09 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:09 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf6d3cb-8e29-4695-b95b-46cfe91337f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:12:09 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d68fea-bcef-4282-b43c-b04b6d9427d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd] added
Aug 14 12:12:09 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0450f8-ced2-4e6c-91df-7cdc562e4dd1]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc04c1cf-a578-4277-b243-19c5cea2caf3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuysKqGE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuysKqGE" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[304f79a1-1ab3-4af4-b076-f04b7ef70a05]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WuysKqGE'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b1ea73-2e20-4a5c-a892-380faf6f3886]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5489e136-ce04-4b63-819c-5a3696dc8df6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:09 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:09 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6404ad6-fffe-45a6-be80-193fc63401f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd, portal: 172.16.0.220,3260]
Aug 14 12:12:09 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd, portal: 172.16.0.220,3260] successful.
Aug 14 12:12:09 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b64aad-e346-44f2-b895-b961788229f2]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f778b9-4a23-42eb-9d17-caa3881a384f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:09 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:09 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:09 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cf4126-0e17-42e0-86ee-2ff6375dec33]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:09 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuysKqGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23236653339623864', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236653339623864', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuGzyjAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:12:10 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:10 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:10 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e523d8-d880-428e-90f1-933d01a40756]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:12:10 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[96297dbc-d4c1-4bec-9878-8f7465dae1ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a] added
Aug 14 12:12:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e288b75b-3663-4611-8481-29fde0234d37]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2f8e0-eace-44ef-be64-96be0ae19f34]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KuGzyjAx {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KuGzyjAx" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d309a0-5586-48ac-bc52-f8dc42e15a95]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KuGzyjAx'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[660e7935-de60-4981-9362-ce671116fdf9]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1fa572-29bc-4e36-94e9-487b9f457910]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:11 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:11 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[382025d5-2bc0-4eba-be26-348848b4aacc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a, portal: 172.16.0.220,3260]
Aug 14 12:12:11 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a, portal: 172.16.0.220,3260] successful.
Aug 14 12:12:11 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc42380-9739-441a-a0bf-8b224bf70d70]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed60783-4183-4e84-83a9-5e48bebae4f6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:11 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:11 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:11 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4c5d38-b8e6-43be-8bd1-d671de74f8c6]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:12:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuGzyjAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23635633535663033', 'path': '/dev/sdf'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635633535663033', 'path': '/dev/sdf'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnayqOZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:12:12 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:12 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:12 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d20e865-0075-470c-bc57-253d98ed75be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:12:12 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d75f49f-c632-4646-8914-a83846f21ef9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271] added
Aug 14 12:12:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[212264cb-74bb-44fb-b23c-11c47185f28d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafed76f-c4f3-47b0-85ad-466d04520e23]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnayqOZV {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnayqOZV" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b663d4ab-fbe5-49bd-bf36-98c2ec2b1446]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hnayqOZV'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b631811-a1cd-46ed-b0d0-975271f7ee78]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e64cd53-68c8-4f41-9cd0-98d42a4efa35]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8597b76c-dd4e-44ad-b129-3371bbebe34a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271, portal: 172.16.0.220,3260]
Aug 14 12:12:12 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271, portal: 172.16.0.220,3260] successful.
Aug 14 12:12:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb2e4a4-3696-4472-b100-19a6237c9f56]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1786a4-8b6c-421b-8af8-94dd7218174a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:12 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d37b148-9adc-4335-83dd-988c4222b106]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:12:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnayqOZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26539653338313462', 'path': '/dev/sdg'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539653338313462', 'path': '/dev/sdg'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:44:85,bridge_name='br-int',has_traffic_filtering=True,id=8f766834-3616-4cde-a637-1e69ea30b119,network=Network(ebdcd18a-4d47-49ef-9fd4-8bc89527bee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f766834-36') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=0e772e4c-640f-4440-83db-edd3ce27c7f8,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e772e4c-64') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=3e2365da-a29b-45bf-bea0-5f20cb9a07e5,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e2365da-a2') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:17:a3,bridge_name='br-int',has_traffic_filtering=True,id=01f3ceea-f399-418f-a617-d60a5734079a,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f3ceea-f3') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:25:90,bridge_name='br-int',has_traffic_filtering=True,id=ce2a4787-3b7d-490d-a9c2-65558de32504,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2a4787-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:8a:1b,bridge_name='br-int',has_traffic_filtering=True,id=62eac28e-c1d0-4be7-aa1b-550d0174481c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eac28e-c1') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:ac,bridge_name='br-int',has_traffic_filtering=True,id=b0ef7268-1dcf-47b3-893c-1401063d1c5c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ef7268-1d') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.objects.instance [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lazy-loading 'pci_devices' on Instance uuid 427440ec-266a-41ab-b7e8-8d4f193d3671 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:12:13 user nova-compute[73012]:   <uuid>427440ec-266a-41ab-b7e8-8d4f193d3671</uuid>
Aug 14 12:12:13 user nova-compute[73012]:   <name>instance-00000013</name>
Aug 14 12:12:13 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:12:13 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:12:13 user nova-compute[73012]:   <metadata>
Aug 14 12:12:13 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:12:13 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:12:13 user nova-compute[73012]:       <nova:name>tempest-device-tagging-server-1458564983</nova:name>
Aug 14 12:12:13 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:12:09</nova:creationTime>
Aug 14 12:12:13 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:12:13 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:12:13 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:12:13 user nova-compute[73012]:       <nova:owner>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:user uuid="3ee6d00a3d5342fa860cc3fcdf3b46aa">tempest-TaggedBootDevicesTest-1914023159-project-member</nova:user>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:project uuid="61e73551aaed4aa6be678848f889f8c7">tempest-TaggedBootDevicesTest-1914023159</nova:project>
Aug 14 12:12:13 user nova-compute[73012]:       </nova:owner>
Aug 14 12:12:13 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:12:13 user nova-compute[73012]:       <nova:ports>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:port uuid="8f766834-3616-4cde-a637-1e69ea30b119">
Aug 14 12:12:13 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 12:12:13 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:port uuid="0e772e4c-640f-4440-83db-edd3ce27c7f8">
Aug 14 12:12:13 user nova-compute[73012]:           <nova:ip type="fixed" address="10.1.1.148" ipVersion="4"/>
Aug 14 12:12:13 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:port uuid="3e2365da-a29b-45bf-bea0-5f20cb9a07e5">
Aug 14 12:12:13 user nova-compute[73012]:           <nova:ip type="fixed" address="10.1.1.92" ipVersion="4"/>
Aug 14 12:12:13 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:port uuid="01f3ceea-f399-418f-a617-d60a5734079a">
Aug 14 12:12:13 user nova-compute[73012]:           <nova:ip type="fixed" address="10.1.1.182" ipVersion="4"/>
Aug 14 12:12:13 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:port uuid="ce2a4787-3b7d-490d-a9c2-65558de32504">
Aug 14 12:12:13 user nova-compute[73012]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
Aug 14 12:12:13 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:port uuid="62eac28e-c1d0-4be7-aa1b-550d0174481c">
Aug 14 12:12:13 user nova-compute[73012]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 12:12:13 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:13 user nova-compute[73012]:         <nova:port uuid="b0ef7268-1dcf-47b3-893c-1401063d1c5c">
Aug 14 12:12:13 user nova-compute[73012]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 12:12:13 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:13 user nova-compute[73012]:       </nova:ports>
Aug 14 12:12:13 user nova-compute[73012]:     </nova:instance>
Aug 14 12:12:13 user nova-compute[73012]:   </metadata>
Aug 14 12:12:13 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:12:13 user nova-compute[73012]:     <system>
Aug 14 12:12:13 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:12:13 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:12:13 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:12:13 user nova-compute[73012]:       <entry name="serial">427440ec-266a-41ab-b7e8-8d4f193d3671</entry>
Aug 14 12:12:13 user nova-compute[73012]:       <entry name="uuid">427440ec-266a-41ab-b7e8-8d4f193d3671</entry>
Aug 14 12:12:13 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:12:13 user nova-compute[73012]:     </system>
Aug 14 12:12:13 user nova-compute[73012]:   </sysinfo>
Aug 14 12:12:13 user nova-compute[73012]:   <os>
Aug 14 12:12:13 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:12:13 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:12:13 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:12:13 user nova-compute[73012]:   </os>
Aug 14 12:12:13 user nova-compute[73012]:   <features>
Aug 14 12:12:13 user nova-compute[73012]:     <acpi/>
Aug 14 12:12:13 user nova-compute[73012]:     <apic/>
Aug 14 12:12:13 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:12:13 user nova-compute[73012]:   </features>
Aug 14 12:12:13 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:12:13 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:12:13 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:12:13 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:12:13 user nova-compute[73012]:   </clock>
Aug 14 12:12:13 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:12:13 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:12:13 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:12:13 user nova-compute[73012]:   </cpu>
Aug 14 12:12:13 user nova-compute[73012]:   <devices>
Aug 14 12:12:13 user nova-compute[73012]:     <disk type="file" device="cdrom">
Aug 14 12:12:13 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 12:12:13 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/427440ec-266a-41ab-b7e8-8d4f193d3671/disk.config"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="hda" bus="ide"/>
Aug 14 12:12:13 user nova-compute[73012]:     </disk>
Aug 14 12:12:13 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:12:13 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:12:13 user nova-compute[73012]:       <source dev="/dev/sdb"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <serial>fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd</serial>
Aug 14 12:12:13 user nova-compute[73012]:     </disk>
Aug 14 12:12:13 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:12:13 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:12:13 user nova-compute[73012]:       <source dev="/dev/sdf"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <serial>b338f7b3-8be1-454e-8f22-65baef92e40a</serial>
Aug 14 12:12:13 user nova-compute[73012]:     </disk>
Aug 14 12:12:13 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:12:13 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:12:13 user nova-compute[73012]:       <source dev="/dev/sdg"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="vdc" bus="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <serial>a72a74ef-560d-4e30-a9ce-8d809b5ed271</serial>
Aug 14 12:12:13 user nova-compute[73012]:     </disk>
Aug 14 12:12:13 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:13 user nova-compute[73012]:       <mac address="fa:16:3e:fa:44:85"/>
Aug 14 12:12:13 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="tap8f766834-36"/>
Aug 14 12:12:13 user nova-compute[73012]:     </interface>
Aug 14 12:12:13 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:13 user nova-compute[73012]:       <mac address="fa:16:3e:0e:1f:5d"/>
Aug 14 12:12:13 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="tap0e772e4c-64"/>
Aug 14 12:12:13 user nova-compute[73012]:     </interface>
Aug 14 12:12:13 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:13 user nova-compute[73012]:       <mac address="fa:16:3e:7e:a4:0f"/>
Aug 14 12:12:13 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="tap3e2365da-a2"/>
Aug 14 12:12:13 user nova-compute[73012]:     </interface>
Aug 14 12:12:13 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:13 user nova-compute[73012]:       <mac address="fa:16:3e:d8:17:a3"/>
Aug 14 12:12:13 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="tap01f3ceea-f3"/>
Aug 14 12:12:13 user nova-compute[73012]:     </interface>
Aug 14 12:12:13 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:13 user nova-compute[73012]:       <mac address="fa:16:3e:5c:25:90"/>
Aug 14 12:12:13 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="tapce2a4787-3b"/>
Aug 14 12:12:13 user nova-compute[73012]:     </interface>
Aug 14 12:12:13 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:13 user nova-compute[73012]:       <mac address="fa:16:3e:5b:8a:1b"/>
Aug 14 12:12:13 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="tap62eac28e-c1"/>
Aug 14 12:12:13 user nova-compute[73012]:     </interface>
Aug 14 12:12:13 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:13 user nova-compute[73012]:       <mac address="fa:16:3e:a0:ee:ac"/>
Aug 14 12:12:13 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:13 user nova-compute[73012]:       <target dev="tapb0ef7268-1d"/>
Aug 14 12:12:13 user nova-compute[73012]:     </interface>
Aug 14 12:12:13 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:12:13 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/427440ec-266a-41ab-b7e8-8d4f193d3671/console.log" append="off"/>
Aug 14 12:12:13 user nova-compute[73012]:     </serial>
Aug 14 12:12:13 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:12:13 user nova-compute[73012]:     <video>
Aug 14 12:12:13 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:13 user nova-compute[73012]:     </video>
Aug 14 12:12:13 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:12:13 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:12:13 user nova-compute[73012]:     </rng>
Aug 14 12:12:13 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:12:13 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:12:13 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:12:13 user nova-compute[73012]:     </memballoon>
Aug 14 12:12:13 user nova-compute[73012]:   </devices>
Aug 14 12:12:13 user nova-compute[73012]: </domain>
Aug 14 12:12:13 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:44:85,bridge_name='br-int',has_traffic_filtering=True,id=8f766834-3616-4cde-a637-1e69ea30b119,network=Network(ebdcd18a-4d47-49ef-9fd4-8bc89527bee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f766834-36') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:44:85,bridge_name='br-int',has_traffic_filtering=True,id=8f766834-3616-4cde-a637-1e69ea30b119,network=Network(ebdcd18a-4d47-49ef-9fd4-8bc89527bee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f766834-36') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f766834-36, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f766834-36, col_values=(('external_ids', {'iface-id': '8f766834-3616-4cde-a637-1e69ea30b119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:44:85', 'vm-uuid': '427440ec-266a-41ab-b7e8-8d4f193d3671'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: INFO os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:44:85,bridge_name='br-int',has_traffic_filtering=True,id=8f766834-3616-4cde-a637-1e69ea30b119,network=Network(ebdcd18a-4d47-49ef-9fd4-8bc89527bee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f766834-36')
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=0e772e4c-640f-4440-83db-edd3ce27c7f8,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e772e4c-64') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=0e772e4c-640f-4440-83db-edd3ce27c7f8,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e772e4c-64') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e772e4c-64, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e772e4c-64, col_values=(('external_ids', {'iface-id': '0e772e4c-640f-4440-83db-edd3ce27c7f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:1f:5d', 'vm-uuid': '427440ec-266a-41ab-b7e8-8d4f193d3671'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: INFO os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=0e772e4c-640f-4440-83db-edd3ce27c7f8,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e772e4c-64')
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=3e2365da-a29b-45bf-bea0-5f20cb9a07e5,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e2365da-a2') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=3e2365da-a29b-45bf-bea0-5f20cb9a07e5,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e2365da-a2') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e2365da-a2, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e2365da-a2, col_values=(('external_ids', {'iface-id': '3e2365da-a29b-45bf-bea0-5f20cb9a07e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:a4:0f', 'vm-uuid': '427440ec-266a-41ab-b7e8-8d4f193d3671'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: INFO os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=3e2365da-a29b-45bf-bea0-5f20cb9a07e5,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e2365da-a2')
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:17:a3,bridge_name='br-int',has_traffic_filtering=True,id=01f3ceea-f399-418f-a617-d60a5734079a,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f3ceea-f3') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:17:a3,bridge_name='br-int',has_traffic_filtering=True,id=01f3ceea-f399-418f-a617-d60a5734079a,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f3ceea-f3') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01f3ceea-f3, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01f3ceea-f3, col_values=(('external_ids', {'iface-id': '01f3ceea-f399-418f-a617-d60a5734079a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:17:a3', 'vm-uuid': '427440ec-266a-41ab-b7e8-8d4f193d3671'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: INFO os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:17:a3,bridge_name='br-int',has_traffic_filtering=True,id=01f3ceea-f399-418f-a617-d60a5734079a,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f3ceea-f3')
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:25:90,bridge_name='br-int',has_traffic_filtering=True,id=ce2a4787-3b7d-490d-a9c2-65558de32504,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2a4787-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:25:90,bridge_name='br-int',has_traffic_filtering=True,id=ce2a4787-3b7d-490d-a9c2-65558de32504,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2a4787-3b') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce2a4787-3b, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce2a4787-3b, col_values=(('external_ids', {'iface-id': 'ce2a4787-3b7d-490d-a9c2-65558de32504', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:25:90', 'vm-uuid': '427440ec-266a-41ab-b7e8-8d4f193d3671'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: INFO os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:25:90,bridge_name='br-int',has_traffic_filtering=True,id=ce2a4787-3b7d-490d-a9c2-65558de32504,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2a4787-3b')
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:8a:1b,bridge_name='br-int',has_traffic_filtering=True,id=62eac28e-c1d0-4be7-aa1b-550d0174481c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eac28e-c1') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:8a:1b,bridge_name='br-int',has_traffic_filtering=True,id=62eac28e-c1d0-4be7-aa1b-550d0174481c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eac28e-c1') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62eac28e-c1, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62eac28e-c1, col_values=(('external_ids', {'iface-id': '62eac28e-c1d0-4be7-aa1b-550d0174481c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:8a:1b', 'vm-uuid': '427440ec-266a-41ab-b7e8-8d4f193d3671'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:13 user nova-compute[73012]: INFO os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:8a:1b,bridge_name='br-int',has_traffic_filtering=True,id=62eac28e-c1d0-4be7-aa1b-550d0174481c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eac28e-c1')
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:ac,bridge_name='br-int',has_traffic_filtering=True,id=b0ef7268-1dcf-47b3-893c-1401063d1c5c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ef7268-1d') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:13 user nova-compute[73012]: DEBUG os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:ac,bridge_name='br-int',has_traffic_filtering=True,id=b0ef7268-1dcf-47b3-893c-1401063d1c5c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ef7268-1d') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0ef7268-1d, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0ef7268-1d, col_values=(('external_ids', {'iface-id': 'b0ef7268-1dcf-47b3-893c-1401063d1c5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:ee:ac', 'vm-uuid': '427440ec-266a-41ab-b7e8-8d4f193d3671'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:14 user nova-compute[73012]: INFO os_vif [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:ac,bridge_name='br-int',has_traffic_filtering=True,id=b0ef7268-1dcf-47b3-893c-1401063d1c5c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ef7268-1d')
Aug 14 12:12:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] No BDM found with device name hda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] No VIF found with MAC fa:16:3e:fa:44:85, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] No VIF found with MAC fa:16:3e:5c:25:90, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:12:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Using config drive
Aug 14 12:12:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Creating config drive at /opt/stack/data/nova/instances/427440ec-266a-41ab-b7e8-8d4f193d3671/disk.config
Aug 14 12:12:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/427440ec-266a-41ab-b7e8-8d4f193d3671/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpngwtl27g {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/427440ec-266a-41ab-b7e8-8d4f193d3671/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpngwtl27g" returned: 0 in 0.073s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-255c623e-4f7c-49bd-914f-60b2c2839d97 req-034fe08d-d1fc-488e-880d-05b110eb39ab service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-255c623e-4f7c-49bd-914f-60b2c2839d97 req-034fe08d-d1fc-488e-880d-05b110eb39ab service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-255c623e-4f7c-49bd-914f-60b2c2839d97 req-034fe08d-d1fc-488e-880d-05b110eb39ab service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-255c623e-4f7c-49bd-914f-60b2c2839d97 req-034fe08d-d1fc-488e-880d-05b110eb39ab service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-255c623e-4f7c-49bd-914f-60b2c2839d97 req-034fe08d-d1fc-488e-880d-05b110eb39ab service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:16 user nova-compute[73012]: WARNING nova.compute.manager [req-255c623e-4f7c-49bd-914f-60b2c2839d97 req-034fe08d-d1fc-488e-880d-05b110eb39ab service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-8f766834-3616-4cde-a637-1e69ea30b119 for instance with vm_state building and task_state spawning.
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-823fafae-9945-4db9-82f4-844a0e75ae73 req-896dc460-95fd-470c-b36d-2f6d4948f8c7 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-823fafae-9945-4db9-82f4-844a0e75ae73 req-896dc460-95fd-470c-b36d-2f6d4948f8c7 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-823fafae-9945-4db9-82f4-844a0e75ae73 req-896dc460-95fd-470c-b36d-2f6d4948f8c7 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-823fafae-9945-4db9-82f4-844a0e75ae73 req-896dc460-95fd-470c-b36d-2f6d4948f8c7 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-823fafae-9945-4db9-82f4-844a0e75ae73 req-896dc460-95fd-470c-b36d-2f6d4948f8c7 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:16 user nova-compute[73012]: WARNING nova.compute.manager [req-823fafae-9945-4db9-82f4-844a0e75ae73 req-896dc460-95fd-470c-b36d-2f6d4948f8c7 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 for instance with vm_state building and task_state spawning.
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "1810186d-ef32-46ff-ba1c-509e9afe1318" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:12:17 user nova-compute[73012]: INFO nova.compute.claims [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Claim successful on node user
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:12:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.policy [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10e35f53a2144a57ab7c200323cccbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae6df64fbac46eeb8de845a5b22b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:12:18 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Creating image(s)
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "/opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "/opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "/opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:18 user nova-compute[73012]: WARNING nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-8f766834-3616-4cde-a637-1e69ea30b119 for instance with vm_state building and task_state spawning.
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:18 user nova-compute[73012]: WARNING nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 for instance with vm_state building and task_state spawning.
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:18 user nova-compute[73012]: WARNING nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 for instance with vm_state building and task_state spawning.
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:18 user nova-compute[73012]: WARNING nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-01f3ceea-f399-418f-a617-d60a5734079a for instance with vm_state building and task_state spawning.
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:18 user nova-compute[73012]: WARNING nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-01f3ceea-f399-418f-a617-d60a5734079a for instance with vm_state building and task_state spawning.
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:18 user nova-compute[73012]: WARNING nova.compute.manager [req-621d87c9-b153-479a-8842-293bee80b713 req-0c1a6c94-5b66-4d29-b8d2-8d1c9341ded2 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-ce2a4787-3b7d-490d-a9c2-65558de32504 for instance with vm_state building and task_state spawning.
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.262s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk 1073741824" returned: 0 in 0.108s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015123.7753491, 4c2979a7-addd-4746-be89-9e5cad4cae3a => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:18 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] VM Stopped (Lifecycle Event)
Aug 14 12:12:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ca741ba-2cae-4cf4-bdb7-3487f6dea1b1 None None] [instance: 4c2979a7-addd-4746-be89-9e5cad4cae3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:18 user nova-compute[73012]: WARNING nova.compute.manager [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 for instance with vm_state building and task_state spawning.
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:18 user nova-compute[73012]: WARNING nova.compute.manager [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c for instance with vm_state building and task_state spawning.
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:18 user nova-compute[73012]: WARNING nova.compute.manager [req-74b10aca-c0c2-41e9-84a6-a54d003049ee req-cee2c83a-85a2-4347-be26-71ba3287bfdf service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c for instance with vm_state building and task_state spawning.
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Successfully created port: ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.238s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:12:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Cannot resize image /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lazy-loading 'migration_context' on Instance uuid 1810186d-ef32-46ff-ba1c-509e9afe1318 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Ensure instance console log exists: /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Successfully updated port: ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "refresh_cache-1810186d-ef32-46ff-ba1c-509e9afe1318" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquired lock "refresh_cache-1810186d-ef32-46ff-ba1c-509e9afe1318" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG nova.compute.manager [req-53f5bce1-5087-4d0e-86ca-8d511f75d045 req-f467acae-ac32-4c53-a7c3-f806a5c87ee3 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received event network-changed-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG nova.compute.manager [req-53f5bce1-5087-4d0e-86ca-8d511f75d045 req-f467acae-ac32-4c53-a7c3-f806a5c87ee3 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Refreshing instance network info cache due to event network-changed-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-53f5bce1-5087-4d0e-86ca-8d511f75d045 req-f467acae-ac32-4c53-a7c3-f806a5c87ee3 service nova] Acquiring lock "refresh_cache-1810186d-ef32-46ff-ba1c-509e9afe1318" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:12:19 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Updating instance_info_cache with network_info: [{"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Releasing lock "refresh_cache-1810186d-ef32-46ff-ba1c-509e9afe1318" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Instance network_info: |[{"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-53f5bce1-5087-4d0e-86ca-8d511f75d045 req-f467acae-ac32-4c53-a7c3-f806a5c87ee3 service nova] Acquired lock "refresh_cache-1810186d-ef32-46ff-ba1c-509e9afe1318" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.network.neutron [req-53f5bce1-5087-4d0e-86ca-8d511f75d045 req-f467acae-ac32-4c53-a7c3-f806a5c87ee3 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Refreshing network info cache for port ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Start _get_guest_xml network_info=[{"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:12:20 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:20 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1160351257',display_name='tempest-ServersNegativeTestJSON-server-1160351257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1160351257',id=20,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eae6df64fbac46eeb8de845a5b22b406',ramdisk_id='',reservation_id='r-y8lfxt3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-78801721',owner_user_name='tempest-ServersNegativeTestJSON-78801721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:12:18Z,user_data=None,user_id='10e35f53a2144a57ab7c200323cccbe5',uuid=1810186d-ef32-46ff-ba1c-509e9afe1318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converting VIF {"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf9b8f5-04') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lazy-loading 'pci_devices' on Instance uuid 1810186d-ef32-46ff-ba1c-509e9afe1318 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:12:20 user nova-compute[73012]:   <uuid>1810186d-ef32-46ff-ba1c-509e9afe1318</uuid>
Aug 14 12:12:20 user nova-compute[73012]:   <name>instance-00000014</name>
Aug 14 12:12:20 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:12:20 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:12:20 user nova-compute[73012]:   <metadata>
Aug 14 12:12:20 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:12:20 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:12:20 user nova-compute[73012]:       <nova:name>tempest-ServersNegativeTestJSON-server-1160351257</nova:name>
Aug 14 12:12:20 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:12:20</nova:creationTime>
Aug 14 12:12:20 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:12:20 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:12:20 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:12:20 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:12:20 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:12:20 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:12:20 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:12:20 user nova-compute[73012]:       <nova:owner>
Aug 14 12:12:20 user nova-compute[73012]:         <nova:user uuid="10e35f53a2144a57ab7c200323cccbe5">tempest-ServersNegativeTestJSON-78801721-project-member</nova:user>
Aug 14 12:12:20 user nova-compute[73012]:         <nova:project uuid="eae6df64fbac46eeb8de845a5b22b406">tempest-ServersNegativeTestJSON-78801721</nova:project>
Aug 14 12:12:20 user nova-compute[73012]:       </nova:owner>
Aug 14 12:12:20 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:12:20 user nova-compute[73012]:       <nova:ports>
Aug 14 12:12:20 user nova-compute[73012]:         <nova:port uuid="ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27">
Aug 14 12:12:20 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 12:12:20 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:20 user nova-compute[73012]:       </nova:ports>
Aug 14 12:12:20 user nova-compute[73012]:     </nova:instance>
Aug 14 12:12:20 user nova-compute[73012]:   </metadata>
Aug 14 12:12:20 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:12:20 user nova-compute[73012]:     <system>
Aug 14 12:12:20 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:12:20 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:12:20 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:12:20 user nova-compute[73012]:       <entry name="serial">1810186d-ef32-46ff-ba1c-509e9afe1318</entry>
Aug 14 12:12:20 user nova-compute[73012]:       <entry name="uuid">1810186d-ef32-46ff-ba1c-509e9afe1318</entry>
Aug 14 12:12:20 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:12:20 user nova-compute[73012]:     </system>
Aug 14 12:12:20 user nova-compute[73012]:   </sysinfo>
Aug 14 12:12:20 user nova-compute[73012]:   <os>
Aug 14 12:12:20 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:12:20 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:12:20 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:12:20 user nova-compute[73012]:   </os>
Aug 14 12:12:20 user nova-compute[73012]:   <features>
Aug 14 12:12:20 user nova-compute[73012]:     <acpi/>
Aug 14 12:12:20 user nova-compute[73012]:     <apic/>
Aug 14 12:12:20 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:12:20 user nova-compute[73012]:   </features>
Aug 14 12:12:20 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:12:20 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:12:20 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:12:20 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:12:20 user nova-compute[73012]:   </clock>
Aug 14 12:12:20 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:12:20 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:12:20 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:12:20 user nova-compute[73012]:   </cpu>
Aug 14 12:12:20 user nova-compute[73012]:   <devices>
Aug 14 12:12:20 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:12:20 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:12:20 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk"/>
Aug 14 12:12:20 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:12:20 user nova-compute[73012]:     </disk>
Aug 14 12:12:20 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:20 user nova-compute[73012]:       <mac address="fa:16:3e:b1:38:3c"/>
Aug 14 12:12:20 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:20 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:20 user nova-compute[73012]:       <target dev="tapddf9b8f5-04"/>
Aug 14 12:12:20 user nova-compute[73012]:     </interface>
Aug 14 12:12:20 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:12:20 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/console.log" append="off"/>
Aug 14 12:12:20 user nova-compute[73012]:     </serial>
Aug 14 12:12:20 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:12:20 user nova-compute[73012]:     <video>
Aug 14 12:12:20 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:20 user nova-compute[73012]:     </video>
Aug 14 12:12:20 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:12:20 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:12:20 user nova-compute[73012]:     </rng>
Aug 14 12:12:20 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:12:20 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:12:20 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:12:20 user nova-compute[73012]:     </memballoon>
Aug 14 12:12:20 user nova-compute[73012]:   </devices>
Aug 14 12:12:20 user nova-compute[73012]: </domain>
Aug 14 12:12:20 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1160351257',display_name='tempest-ServersNegativeTestJSON-server-1160351257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1160351257',id=20,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eae6df64fbac46eeb8de845a5b22b406',ramdisk_id='',reservation_id='r-y8lfxt3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-78801721',owner_user_name='tempest-ServersNegativeTestJSON-78801721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:12:18Z,user_data=None,user_id='10e35f53a2144a57ab7c200323cccbe5',uuid=1810186d-ef32-46ff-ba1c-509e9afe1318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converting VIF {"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf9b8f5-04') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG os_vif [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf9b8f5-04') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddf9b8f5-04, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapddf9b8f5-04, col_values=(('external_ids', {'iface-id': 'ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:38:3c', 'vm-uuid': '1810186d-ef32-46ff-ba1c-509e9afe1318'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:20 user nova-compute[73012]: INFO os_vif [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf9b8f5-04')
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] No VIF found with MAC fa:16:3e:b1:38:3c, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015140.5141494, 427440ec-266a-41ab-b7e8-8d4f193d3671 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:20 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] VM Resumed (Lifecycle Event)
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:12:20 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance spawned successfully.
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:20 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015140.5171366, 427440ec-266a-41ab-b7e8-8d4f193d3671 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:20 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] VM Started (Lifecycle Event)
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:20 user nova-compute[73012]: WARNING nova.compute.manager [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-ce2a4787-3b7d-490d-a9c2-65558de32504 for instance with vm_state building and task_state spawning.
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:20 user nova-compute[73012]: WARNING nova.compute.manager [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-62eac28e-c1d0-4be7-aa1b-550d0174481c for instance with vm_state building and task_state spawning.
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:20 user nova-compute[73012]: WARNING nova.compute.manager [req-4fbddefc-9501-47ca-86ba-5369b4f2d8a6 req-8df628d7-6494-4df5-b2ea-58567627439c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-62eac28e-c1d0-4be7-aa1b-550d0174481c for instance with vm_state building and task_state spawning.
Aug 14 12:12:20 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:12:20 user nova-compute[73012]: INFO nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Took 11.34 seconds to spawn the instance on the hypervisor.
Aug 14 12:12:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:20 user nova-compute[73012]: INFO nova.compute.manager [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Took 42.26 seconds to build instance.
Aug 14 12:12:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02116532-2614-44bb-9700-c064e9b9753f tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.354s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:21 user nova-compute[73012]: INFO nova.compute.manager [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Unshelving
Aug 14 12:12:21 user nova-compute[73012]: DEBUG nova.network.neutron [req-53f5bce1-5087-4d0e-86ca-8d511f75d045 req-f467acae-ac32-4c53-a7c3-f806a5c87ee3 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Updated VIF entry in instance network info cache for port ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG nova.network.neutron [req-53f5bce1-5087-4d0e-86ca-8d511f75d045 req-f467acae-ac32-4c53-a7c3-f806a5c87ee3 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Updating instance_info_cache with network_info: [{"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:21 user nova-compute[73012]: INFO nova.virt.block_device [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Booting with volume ae658aa7-5072-4837-a2ba-a4221136e98b at /dev/vda
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-53f5bce1-5087-4d0e-86ca-8d511f75d045 req-f467acae-ac32-4c53-a7c3-f806a5c87ee3 service nova] Releasing lock "refresh_cache-1810186d-ef32-46ff-ba1c-509e9afe1318" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG os_brick.utils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[528826a4-01f2-48b3-a4a5-575eaea019ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c18efbd-3b52-4e88-a11c-cc8483e25a46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[89067d44-14f5-47d0-b213-a1f40e106376]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deb1ffe-fc59-4dc2-850a-c197206b6564]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:12:21 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:12:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd53aeb-9ffa-48c0-a726-450acb68d4c5]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG os_brick.utils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating existing volume attachment record: 39721eb3-27bf-4688-b39c-ab93a77c220f {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received event network-vif-plugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] Acquiring lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] No waiting events found dispatching network-vif-plugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:22 user nova-compute[73012]: WARNING nova.compute.manager [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received unexpected event network-vif-plugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 for instance with vm_state building and task_state spawning.
Aug 14 12:12:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received event network-vif-plugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] Acquiring lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] No waiting events found dispatching network-vif-plugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:22 user nova-compute[73012]: WARNING nova.compute.manager [req-09240ef7-0c21-47b1-8a29-45497aa0776d req-0555f5e8-7098-4168-9cb8-6b67966b3f3c service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received unexpected event network-vif-plugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 for instance with vm_state building and task_state spawning.
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015144.2832637, 1810186d-ef32-46ff-ba1c-509e9afe1318 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:24 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] VM Resumed (Lifecycle Event)
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:12:24 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Instance spawned successfully.
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:24 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015144.28444, 1810186d-ef32-46ff-ba1c-509e9afe1318 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:24 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] VM Started (Lifecycle Event)
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:12:24 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:12:24 user nova-compute[73012]: INFO nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 14 12:12:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:24 user nova-compute[73012]: INFO nova.compute.manager [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Took 7.46 seconds to build instance.
Aug 14 12:12:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d8555dac-062f-4f48-88bb-4c853f600502 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.608s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 66fb72b1-30a9-4be2-b843-7d648fc66e16 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid e2017069-2aa6-4cd0-b12f-16af7887b48b {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 427440ec-266a-41ab-b7e8-8d4f193d3671 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 1810186d-ef32-46ff-ba1c-509e9afe1318 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "1810186d-ef32-46ff-ba1c-509e9afe1318" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:12:30 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updating instance_info_cache with network_info: [{"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:31 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:12:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:12:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:12:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:12:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG nova.objects.instance [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lazy-loading 'pci_requests' on Instance uuid dadd3d4a-74da-416f-935c-2b064ea2ec16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG nova.objects.instance [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lazy-loading 'numa_topology' on Instance uuid dadd3d4a-74da-416f-935c-2b064ea2ec16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:12:33 user nova-compute[73012]: INFO nova.compute.claims [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Claim successful on node user
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:12:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.749s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:34 user nova-compute[73012]: INFO nova.network.neutron [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating port 93451164-a21f-49aa-991b-a941f82c80ee with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquired lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-16936514-56bf-4dce-8520-16bd5151af16 req-f3b3aca1-802e-4d85-a58c-e5913ec31058 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-changed-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-16936514-56bf-4dce-8520-16bd5151af16 req-f3b3aca1-802e-4d85-a58c-e5913ec31058 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing instance network info cache due to event network-changed-93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:12:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-16936514-56bf-4dce-8520-16bd5151af16 req-f3b3aca1-802e-4d85-a58c-e5913ec31058 service nova] Acquiring lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating instance_info_cache with network_info: [{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:36 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:36 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:36 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7410MB free_disk=25.47915267944336GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Releasing lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:12:36 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Creating image(s)
Aug 14 12:12:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Ensure instance console log exists: /opt/stack/data/nova/instances/dadd3d4a-74da-416f-935c-2b064ea2ec16/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Start _get_guest_xml network_info=[{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMgAODHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dadd3d4a-74da-416f-935c-2b064ea2ec16', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae658aa7-5072-4837-a2ba-a4221136e98b', 'serial': 'ae658aa7-5072-4837-a2ba-a4221136e98b'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '39721eb3-27bf-4688-b39c-ab93a77c220f', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-16936514-56bf-4dce-8520-16bd5151af16 req-f3b3aca1-802e-4d85-a58c-e5913ec31058 service nova] Acquired lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:12:36 user nova-compute[73012]: DEBUG nova.network.neutron [req-16936514-56bf-4dce-8520-16bd5151af16 req-f3b3aca1-802e-4d85-a58c-e5913ec31058 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:12:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lazy-loading 'vcpu_model' on Instance uuid dadd3d4a-74da-416f-935c-2b064ea2ec16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMgAODHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:12:37 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:37 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:37 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260" returned: 21 in 0.062s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[73612c34-7a51-4f19-ae56-7bded1460047]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:12:37 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23282a7-eadd-4c19-b4d5-2e73ca247f4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b] added
Aug 14 12:12:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e2017069-2aa6-4cd0-b12f-16af7887b48b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 427440ec-266a-41ab-b7e8-8d4f193d3671 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 1810186d-ef32-46ff-ba1c-509e9afe1318 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (18c3368b-9ede-4a07-be2d-712c9b5eb568): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8481b1da-39f6-4700-94dd-a23213a2a492]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1a9499-9620-462f-b179-608fbdaba1d4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMgAODHz {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WMgAODHz" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ce51d8-9620-4f15-aea2-7f7cc5debab7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WMgAODHz'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0f35dd-ceea-4d44-ac24-299f7a2ac438]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6c5efa-b8ff-468b-9d12-c4c7be002935]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fa42fe-e3b3-41e6-b6a6-c4d200d51758]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260]
Aug 14 12:12:37 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260] successful.
Aug 14 12:12:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[490c4692-bccd-41cd-a58c-de387baf1570]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.112s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9439d589-1c3b-442d-9c11-53732ddb24f0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:12:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:37 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:12:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.618s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] HCTL ('40', '-', '-', 0) found on session 21 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2cfc26-97c6-4947-a340-5e742012effa]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Searching for a device in session 21 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMgAODHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:12:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.951s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.network.neutron [req-16936514-56bf-4dce-8520-16bd5151af16 req-f3b3aca1-802e-4d85-a58c-e5913ec31058 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updated VIF entry in instance network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.network.neutron [req-16936514-56bf-4dce-8520-16bd5151af16 req-f3b3aca1-802e-4d85-a58c-e5913ec31058 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating instance_info_cache with network_info: [{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-16936514-56bf-4dce-8520-16bd5151af16 req-f3b3aca1-802e-4d85-a58c-e5913ec31058 service nova] Releasing lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.712s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] <== connect_volume: return (1716ms) {'type': 'block', 'scsi_wwn': '23463333661366631', 'path': '/dev/sdi'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463333661366631', 'path': '/dev/sdi'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1274032774',display_name='tempest-TestShelveInstance-server-1274032774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1274032774',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-584983205',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e44af87d2aa64185ad02ba16d7cfe6b4',ramdisk_id='',reservation_id='r-thm9qhfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-588328482',owner_user_name='tempest-TestShelveInstance-588328482-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:21Z,user_data=None,user_id='ab939cda27a1447088d51c94b161f4d3',uuid=dadd3d4a-74da-416f-935c-2b064ea2ec16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converting VIF {"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lazy-loading 'pci_devices' on Instance uuid dadd3d4a-74da-416f-935c-2b064ea2ec16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:12:38 user nova-compute[73012]:   <uuid>dadd3d4a-74da-416f-935c-2b064ea2ec16</uuid>
Aug 14 12:12:38 user nova-compute[73012]:   <name>instance-0000000b</name>
Aug 14 12:12:38 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:12:38 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:12:38 user nova-compute[73012]:   <metadata>
Aug 14 12:12:38 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:12:38 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:12:38 user nova-compute[73012]:       <nova:name>tempest-TestShelveInstance-server-1274032774</nova:name>
Aug 14 12:12:38 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:12:37</nova:creationTime>
Aug 14 12:12:38 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:12:38 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:12:38 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:12:38 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:12:38 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:12:38 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:12:38 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:12:38 user nova-compute[73012]:       <nova:owner>
Aug 14 12:12:38 user nova-compute[73012]:         <nova:user uuid="ab939cda27a1447088d51c94b161f4d3">tempest-TestShelveInstance-588328482-project-member</nova:user>
Aug 14 12:12:38 user nova-compute[73012]:         <nova:project uuid="e44af87d2aa64185ad02ba16d7cfe6b4">tempest-TestShelveInstance-588328482</nova:project>
Aug 14 12:12:38 user nova-compute[73012]:       </nova:owner>
Aug 14 12:12:38 user nova-compute[73012]:       <nova:ports>
Aug 14 12:12:38 user nova-compute[73012]:         <nova:port uuid="93451164-a21f-49aa-991b-a941f82c80ee">
Aug 14 12:12:38 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 12:12:38 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:38 user nova-compute[73012]:       </nova:ports>
Aug 14 12:12:38 user nova-compute[73012]:     </nova:instance>
Aug 14 12:12:38 user nova-compute[73012]:   </metadata>
Aug 14 12:12:38 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:12:38 user nova-compute[73012]:     <system>
Aug 14 12:12:38 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:12:38 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:12:38 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:12:38 user nova-compute[73012]:       <entry name="serial">dadd3d4a-74da-416f-935c-2b064ea2ec16</entry>
Aug 14 12:12:38 user nova-compute[73012]:       <entry name="uuid">dadd3d4a-74da-416f-935c-2b064ea2ec16</entry>
Aug 14 12:12:38 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:12:38 user nova-compute[73012]:     </system>
Aug 14 12:12:38 user nova-compute[73012]:   </sysinfo>
Aug 14 12:12:38 user nova-compute[73012]:   <os>
Aug 14 12:12:38 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:12:38 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:12:38 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:12:38 user nova-compute[73012]:   </os>
Aug 14 12:12:38 user nova-compute[73012]:   <features>
Aug 14 12:12:38 user nova-compute[73012]:     <acpi/>
Aug 14 12:12:38 user nova-compute[73012]:     <apic/>
Aug 14 12:12:38 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:12:38 user nova-compute[73012]:   </features>
Aug 14 12:12:38 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:12:38 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:12:38 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:12:38 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:12:38 user nova-compute[73012]:   </clock>
Aug 14 12:12:38 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:12:38 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:12:38 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:12:38 user nova-compute[73012]:   </cpu>
Aug 14 12:12:38 user nova-compute[73012]:   <devices>
Aug 14 12:12:38 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:12:38 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:12:38 user nova-compute[73012]:       <source dev="/dev/sdi"/>
Aug 14 12:12:38 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:12:38 user nova-compute[73012]:       <serial>ae658aa7-5072-4837-a2ba-a4221136e98b</serial>
Aug 14 12:12:38 user nova-compute[73012]:     </disk>
Aug 14 12:12:38 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:38 user nova-compute[73012]:       <mac address="fa:16:3e:84:b1:ad"/>
Aug 14 12:12:38 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:38 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:38 user nova-compute[73012]:       <target dev="tap93451164-a2"/>
Aug 14 12:12:38 user nova-compute[73012]:     </interface>
Aug 14 12:12:38 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:12:38 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/dadd3d4a-74da-416f-935c-2b064ea2ec16/console.log" append="off"/>
Aug 14 12:12:38 user nova-compute[73012]:     </serial>
Aug 14 12:12:38 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:12:38 user nova-compute[73012]:     <video>
Aug 14 12:12:38 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:38 user nova-compute[73012]:     </video>
Aug 14 12:12:38 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:12:38 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:12:38 user nova-compute[73012]:     </rng>
Aug 14 12:12:38 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:12:38 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:12:38 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:12:38 user nova-compute[73012]:     </memballoon>
Aug 14 12:12:38 user nova-compute[73012]:   </devices>
Aug 14 12:12:38 user nova-compute[73012]: </domain>
Aug 14 12:12:38 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1274032774',display_name='tempest-TestShelveInstance-server-1274032774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1274032774',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-584983205',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e44af87d2aa64185ad02ba16d7cfe6b4',ramdisk_id='',reservation_id='r-thm9qhfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-588328482',owner_user_name='tempest-TestShelveInstance-588328482-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:21Z,user_data=None,user_id='ab939cda27a1447088d51c94b161f4d3',uuid=dadd3d4a-74da-416f-935c-2b064ea2ec16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converting VIF {"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG os_vif [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93451164-a2, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93451164-a2, col_values=(('external_ids', {'iface-id': '93451164-a21f-49aa-991b-a941f82c80ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:b1:ad', 'vm-uuid': 'dadd3d4a-74da-416f-935c-2b064ea2ec16'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:39 user nova-compute[73012]: INFO os_vif [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2')
Aug 14 12:12:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] No VIF found with MAC fa:16:3e:84:b1:ad, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:12:39 user nova-compute[73012]: INFO nova.compute.claims [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Claim successful on node user
Aug 14 12:12:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-f7015b2c-e47a-444d-b500-6efbe6c83dc3 req-bf94fc05-d835-4d7c-a49f-5f05e70e770a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-changed-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-f7015b2c-e47a-444d-b500-6efbe6c83dc3 req-bf94fc05-d835-4d7c-a49f-5f05e70e770a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing instance network info cache due to event network-changed-5e30ee37-0c0f-48b1-8719-f949bcf47c10. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f7015b2c-e47a-444d-b500-6efbe6c83dc3 req-bf94fc05-d835-4d7c-a49f-5f05e70e770a service nova] Acquiring lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f7015b2c-e47a-444d-b500-6efbe6c83dc3 req-bf94fc05-d835-4d7c-a49f-5f05e70e770a service nova] Acquired lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:12:39 user nova-compute[73012]: DEBUG nova.network.neutron [req-f7015b2c-e47a-444d-b500-6efbe6c83dc3 req-bf94fc05-d835-4d7c-a49f-5f05e70e770a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Refreshing network info cache for port 5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:12:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:12:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:12:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Creating image(s)
Aug 14 12:12:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG nova.policy [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d6c467aee6140bda719332345af7ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5064d145e48eab20dc7ee82bdf779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.626s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.341s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-d8bd30f1-eecf-49fd-8c13-9310c960872f req-255e6e4d-10d5-4310-b32e-0fb19c85923a service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d8bd30f1-eecf-49fd-8c13-9310c960872f req-255e6e4d-10d5-4310-b32e-0fb19c85923a service nova] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d8bd30f1-eecf-49fd-8c13-9310c960872f req-255e6e4d-10d5-4310-b32e-0fb19c85923a service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d8bd30f1-eecf-49fd-8c13-9310c960872f req-255e6e4d-10d5-4310-b32e-0fb19c85923a service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-d8bd30f1-eecf-49fd-8c13-9310c960872f req-255e6e4d-10d5-4310-b32e-0fb19c85923a service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] No waiting events found dispatching network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:41 user nova-compute[73012]: WARNING nova.compute.manager [req-d8bd30f1-eecf-49fd-8c13-9310c960872f req-255e6e4d-10d5-4310-b32e-0fb19c85923a service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received unexpected event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk 1073741824" returned: 0 in 0.572s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.918s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-f7015b2c-e47a-444d-b500-6efbe6c83dc3 req-bf94fc05-d835-4d7c-a49f-5f05e70e770a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updated VIF entry in instance network info cache for port 5e30ee37-0c0f-48b1-8719-f949bcf47c10. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-f7015b2c-e47a-444d-b500-6efbe6c83dc3 req-bf94fc05-d835-4d7c-a49f-5f05e70e770a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [{"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.266s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f7015b2c-e47a-444d-b500-6efbe6c83dc3 req-bf94fc05-d835-4d7c-a49f-5f05e70e770a service nova] Releasing lock "refresh_cache-e2017069-2aa6-4cd0-b12f-16af7887b48b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Cannot resize image /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'migration_context' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Ensure instance console log exists: /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:43 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Successfully created port: a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:12:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-2153c132-1638-4298-925b-35bbf308d7d0 req-c3095c79-1708-4f96-9f0c-4e7cdac170eb service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2153c132-1638-4298-925b-35bbf308d7d0 req-c3095c79-1708-4f96-9f0c-4e7cdac170eb service nova] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2153c132-1638-4298-925b-35bbf308d7d0 req-c3095c79-1708-4f96-9f0c-4e7cdac170eb service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2153c132-1638-4298-925b-35bbf308d7d0 req-c3095c79-1708-4f96-9f0c-4e7cdac170eb service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-2153c132-1638-4298-925b-35bbf308d7d0 req-c3095c79-1708-4f96-9f0c-4e7cdac170eb service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] No waiting events found dispatching network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:43 user nova-compute[73012]: WARNING nova.compute.manager [req-2153c132-1638-4298-925b-35bbf308d7d0 req-c3095c79-1708-4f96-9f0c-4e7cdac170eb service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received unexpected event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 12:12:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:45 user nova-compute[73012]: INFO nova.compute.manager [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Terminating instance
Aug 14 12:12:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-52d8d51c-cc6b-4fc2-a491-07c810e9955e req-12a2e604-516e-46e8-95b3-359191136a74 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-52d8d51c-cc6b-4fc2-a491-07c810e9955e req-12a2e604-516e-46e8-95b3-359191136a74 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-52d8d51c-cc6b-4fc2-a491-07c810e9955e req-12a2e604-516e-46e8-95b3-359191136a74 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-52d8d51c-cc6b-4fc2-a491-07c810e9955e req-12a2e604-516e-46e8-95b3-359191136a74 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-52d8d51c-cc6b-4fc2-a491-07c810e9955e req-12a2e604-516e-46e8-95b3-359191136a74 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-unplugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-52d8d51c-cc6b-4fc2-a491-07c810e9955e req-12a2e604-516e-46e8-95b3-359191136a74 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Successfully updated port: a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "refresh_cache-0d1c12d3-8962-49e8-8ad5-071caee70b94" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquired lock "refresh_cache-0d1c12d3-8962-49e8-8ad5-071caee70b94" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-ad0d65c5-ec74-4a6c-8ada-1d86c0041024 req-54adfb36-ba51-46a2-92da-0f86cc5c913d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ad0d65c5-ec74-4a6c-8ada-1d86c0041024 req-54adfb36-ba51-46a2-92da-0f86cc5c913d service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ad0d65c5-ec74-4a6c-8ada-1d86c0041024 req-54adfb36-ba51-46a2-92da-0f86cc5c913d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ad0d65c5-ec74-4a6c-8ada-1d86c0041024 req-54adfb36-ba51-46a2-92da-0f86cc5c913d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-ad0d65c5-ec74-4a6c-8ada-1d86c0041024 req-54adfb36-ba51-46a2-92da-0f86cc5c913d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-unplugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-ad0d65c5-ec74-4a6c-8ada-1d86c0041024 req-54adfb36-ba51-46a2-92da-0f86cc5c913d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015166.560033, dadd3d4a-74da-416f-935c-2b064ea2ec16 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:46 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] VM Resumed (Lifecycle Event)
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:12:46 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance spawned successfully.
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:12:46 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015166.569485, dadd3d4a-74da-416f-935c-2b064ea2ec16 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:46 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] VM Started (Lifecycle Event)
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:12:46 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:12:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2c93f7ed-f6f2-4425-8f0a-8129c5004c0f tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.815s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-8e30dffb-c244-44e3-904e-2bd1833d541a req-d26abf45-c818-4ece-9b27-9221c1d0b4e8 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8e30dffb-c244-44e3-904e-2bd1833d541a req-d26abf45-c818-4ece-9b27-9221c1d0b4e8 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8e30dffb-c244-44e3-904e-2bd1833d541a req-d26abf45-c818-4ece-9b27-9221c1d0b4e8 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8e30dffb-c244-44e3-904e-2bd1833d541a req-d26abf45-c818-4ece-9b27-9221c1d0b4e8 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-8e30dffb-c244-44e3-904e-2bd1833d541a req-d26abf45-c818-4ece-9b27-9221c1d0b4e8 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-unplugged-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-8e30dffb-c244-44e3-904e-2bd1833d541a req-d26abf45-c818-4ece-9b27-9221c1d0b4e8 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-78c215c5-4cf9-407c-8f72-927553c1b299 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:12:47 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Instance destroyed successfully.
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.objects.instance [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lazy-loading 'resources' on Instance uuid e2017069-2aa6-4cd0-b12f-16af7887b48b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:f5:72,bridge_name='br-int',has_traffic_filtering=True,id=5e30ee37-0c0f-48b1-8719-f949bcf47c10,network=Network(674aed60-730e-4e10-a46b-ac3b156cd2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e30ee37-0c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:f5:72,bridge_name='br-int',has_traffic_filtering=True,id=5e30ee37-0c0f-48b1-8719-f949bcf47c10,network=Network(674aed60-730e-4e10-a46b-ac3b156cd2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e30ee37-0c') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Updating instance_info_cache with network_info: [{"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e30ee37-0c, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Releasing lock "refresh_cache-0d1c12d3-8962-49e8-8ad5-071caee70b94" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Instance network_info: |[{"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Start _get_guest_xml network_info=[{"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:12:47 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:47 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993015962',display_name='tempest-tempest.common.compute-instance-1993015962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993015962',id=21,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtgn7jI0ij2H9jUYjkccKsYICC7IYYfLPdrPhf/txsC9h/wIuzHlUOu4tO1XNh3I/gHCdax/I0yp+dw9TF/JX47JXH1n7A4tRx6CChv+xyFdBvhBqcME74oyp+lIXw0hQ==',key_name='tempest-keypair-427987902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-k5j0guq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=0d1c12d3-8962-49e8-8ad5-071caee70b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: INFO os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:f5:72,bridge_name='br-int',has_traffic_filtering=True,id=5e30ee37-0c0f-48b1-8719-f949bcf47c10,network=Network(674aed60-730e-4e10-a46b-ac3b156cd2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e30ee37-0c')
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:07:6c,bridge_name='br-int',has_traffic_filtering=True,id=94f3ff54-1015-4d97-a5d8-1700aa55cd98,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94f3ff54-10') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:07:6c,bridge_name='br-int',has_traffic_filtering=True,id=94f3ff54-1015-4d97-a5d8-1700aa55cd98,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94f3ff54-10') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:12:47 user nova-compute[73012]:   <uuid>0d1c12d3-8962-49e8-8ad5-071caee70b94</uuid>
Aug 14 12:12:47 user nova-compute[73012]:   <name>instance-00000015</name>
Aug 14 12:12:47 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:12:47 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:12:47 user nova-compute[73012]:   <metadata>
Aug 14 12:12:47 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:12:47 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:12:47 user nova-compute[73012]:       <nova:name>tempest-tempest.common.compute-instance-1993015962</nova:name>
Aug 14 12:12:47 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:12:47</nova:creationTime>
Aug 14 12:12:47 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:12:47 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:12:47 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:12:47 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:12:47 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:12:47 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:12:47 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:12:47 user nova-compute[73012]:       <nova:owner>
Aug 14 12:12:47 user nova-compute[73012]:         <nova:user uuid="7d6c467aee6140bda719332345af7ec0">tempest-ServerActionsTestOtherA-975401032-project-member</nova:user>
Aug 14 12:12:47 user nova-compute[73012]:         <nova:project uuid="33d5064d145e48eab20dc7ee82bdf779">tempest-ServerActionsTestOtherA-975401032</nova:project>
Aug 14 12:12:47 user nova-compute[73012]:       </nova:owner>
Aug 14 12:12:47 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:12:47 user nova-compute[73012]:       <nova:ports>
Aug 14 12:12:47 user nova-compute[73012]:         <nova:port uuid="a3cb9338-9b9e-48ed-9da8-1cef3094170d">
Aug 14 12:12:47 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 12:12:47 user nova-compute[73012]:         </nova:port>
Aug 14 12:12:47 user nova-compute[73012]:       </nova:ports>
Aug 14 12:12:47 user nova-compute[73012]:     </nova:instance>
Aug 14 12:12:47 user nova-compute[73012]:   </metadata>
Aug 14 12:12:47 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:12:47 user nova-compute[73012]:     <system>
Aug 14 12:12:47 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:12:47 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:12:47 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:12:47 user nova-compute[73012]:       <entry name="serial">0d1c12d3-8962-49e8-8ad5-071caee70b94</entry>
Aug 14 12:12:47 user nova-compute[73012]:       <entry name="uuid">0d1c12d3-8962-49e8-8ad5-071caee70b94</entry>
Aug 14 12:12:47 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:12:47 user nova-compute[73012]:     </system>
Aug 14 12:12:47 user nova-compute[73012]:   </sysinfo>
Aug 14 12:12:47 user nova-compute[73012]:   <os>
Aug 14 12:12:47 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:12:47 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:12:47 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:12:47 user nova-compute[73012]:   </os>
Aug 14 12:12:47 user nova-compute[73012]:   <features>
Aug 14 12:12:47 user nova-compute[73012]:     <acpi/>
Aug 14 12:12:47 user nova-compute[73012]:     <apic/>
Aug 14 12:12:47 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:12:47 user nova-compute[73012]:   </features>
Aug 14 12:12:47 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:12:47 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:12:47 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:12:47 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:12:47 user nova-compute[73012]:   </clock>
Aug 14 12:12:47 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:12:47 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:12:47 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:12:47 user nova-compute[73012]:   </cpu>
Aug 14 12:12:47 user nova-compute[73012]:   <devices>
Aug 14 12:12:47 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:12:47 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:12:47 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk"/>
Aug 14 12:12:47 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:12:47 user nova-compute[73012]:     </disk>
Aug 14 12:12:47 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:12:47 user nova-compute[73012]:       <mac address="fa:16:3e:07:9f:e3"/>
Aug 14 12:12:47 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:47 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:12:47 user nova-compute[73012]:       <target dev="tapa3cb9338-9b"/>
Aug 14 12:12:47 user nova-compute[73012]:     </interface>
Aug 14 12:12:47 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:12:47 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/console.log" append="off"/>
Aug 14 12:12:47 user nova-compute[73012]:     </serial>
Aug 14 12:12:47 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:12:47 user nova-compute[73012]:     <video>
Aug 14 12:12:47 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:12:47 user nova-compute[73012]:     </video>
Aug 14 12:12:47 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:12:47 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:12:47 user nova-compute[73012]:     </rng>
Aug 14 12:12:47 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:12:47 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:12:47 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:12:47 user nova-compute[73012]:     </memballoon>
Aug 14 12:12:47 user nova-compute[73012]:   </devices>
Aug 14 12:12:47 user nova-compute[73012]: </domain>
Aug 14 12:12:47 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993015962',display_name='tempest-tempest.common.compute-instance-1993015962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993015962',id=21,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtgn7jI0ij2H9jUYjkccKsYICC7IYYfLPdrPhf/txsC9h/wIuzHlUOu4tO1XNh3I/gHCdax/I0yp+dw9TF/JX47JXH1n7A4tRx6CChv+xyFdBvhBqcME74oyp+lIXw0hQ==',key_name='tempest-keypair-427987902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-k5j0guq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:12:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=0d1c12d3-8962-49e8-8ad5-071caee70b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG os_vif [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94f3ff54-10, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:12:47 user nova-compute[73012]: INFO os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:07:6c,bridge_name='br-int',has_traffic_filtering=True,id=94f3ff54-1015-4d97-a5d8-1700aa55cd98,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap94f3ff54-10')
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ee:bc,bridge_name='br-int',has_traffic_filtering=True,id=ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped0b4a4d-6d') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ee:bc,bridge_name='br-int',has_traffic_filtering=True,id=ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped0b4a4d-6d') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped0b4a4d-6d, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3cb9338-9b, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3cb9338-9b, col_values=(('external_ids', {'iface-id': 'a3cb9338-9b9e-48ed-9da8-1cef3094170d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:9f:e3', 'vm-uuid': '0d1c12d3-8962-49e8-8ad5-071caee70b94'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:47 user nova-compute[73012]: INFO os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ee:bc,bridge_name='br-int',has_traffic_filtering=True,id=ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped0b4a4d-6d')
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "address": "fa:16:3e:75:e6:91", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22b2f7-3b", "ovs_interfaceid": "1e22b2f7-3b42-40bd-9cf5-c64e63eeb001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:91,bridge_name='br-int',has_traffic_filtering=True,id=1e22b2f7-3b42-40bd-9cf5-c64e63eeb001,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22b2f7-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:91,bridge_name='br-int',has_traffic_filtering=True,id=1e22b2f7-3b42-40bd-9cf5-c64e63eeb001,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22b2f7-3b') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: INFO os_vif [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b')
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e22b2f7-3b, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-changed-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Refreshing instance network info cache due to event network-changed-a3cb9338-9b9e-48ed-9da8-1cef3094170d. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Acquiring lock "refresh_cache-0d1c12d3-8962-49e8-8ad5-071caee70b94" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Acquired lock "refresh_cache-0d1c12d3-8962-49e8-8ad5-071caee70b94" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.neutron [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Refreshing network info cache for port a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: INFO os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:91,bridge_name='br-int',has_traffic_filtering=True,id=1e22b2f7-3b42-40bd-9cf5-c64e63eeb001,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22b2f7-3b')
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:6d:13,bridge_name='br-int',has_traffic_filtering=True,id=63039d69-9348-496a-9acc-7a527f14c14d,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63039d69-93') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:6d:13,bridge_name='br-int',has_traffic_filtering=True,id=63039d69-9348-496a-9acc-7a527f14c14d,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63039d69-93') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63039d69-93, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:12:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No VIF found with MAC fa:16:3e:07:9f:e3, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:48 user nova-compute[73012]: INFO os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:6d:13,bridge_name='br-int',has_traffic_filtering=True,id=63039d69-9348-496a-9acc-7a527f14c14d,network=Network(bae7fbd7-63a1-4e14-82d7-7e4db3606163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63039d69-93')
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d8:0b,bridge_name='br-int',has_traffic_filtering=True,id=78c215c5-4cf9-407c-8f72-927553c1b299,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c215c5-4c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d8:0b,bridge_name='br-int',has_traffic_filtering=True,id=78c215c5-4cf9-407c-8f72-927553c1b299,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c215c5-4c') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78c215c5-4c, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:48 user nova-compute[73012]: INFO os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d8:0b,bridge_name='br-int',has_traffic_filtering=True,id=78c215c5-4cf9-407c-8f72-927553c1b299,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c215c5-4c')
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1662986421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1662986421',id=18,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBcB2OCEJxErkfz9jr9LQWGAYXQRrcLTHs9xxlzgdsFLcP+vaHJvn5aixyck1+/RbLFBC5LT5zwKaoxf3x3YQZUfmgT1gEitnAdxc0Nlt2csSvNeNmoT1ZVuf4Qh2XDdQ==',key_name='tempest-keypair-53517494',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e0f9d241b964ed3a36a9bb4b590ef6a',ramdisk_id='',reservation_id='r-tw0n4c85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2061817737',owner_user_name='tempest-TaggedBootDevicesTest_v242-2061817737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4acd9a2410441795c6a397946130cd',uuid=e2017069-2aa6-4cd0-b12f-16af7887b48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converting VIF {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=f1f01a68-a0eb-4d18-8d8d-80097ae41d56,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f01a68-a0') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=f1f01a68-a0eb-4d18-8d8d-80097ae41d56,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f01a68-a0') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1f01a68-a0, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:48 user nova-compute[73012]: INFO os_vif [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=f1f01a68-a0eb-4d18-8d8d-80097ae41d56,network=Network(acf10702-b100-41cd-a3ea-d42655563289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f01a68-a0')
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGdBbvVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:12:48 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c740d92-8820-4d80-a401-751027a57e0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:48 user nova-compute[73012]: WARNING nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-94f3ff54-1015-4d97-a5d8-1700aa55cd98 for instance with vm_state active and task_state deleting.
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-unplugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:48 user nova-compute[73012]: WARNING nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019 for instance with vm_state active and task_state deleting.
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-unplugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f617a5d-716e-40da-9cd1-c9519818fcde req-b92074b9-4a75-4493-bd32-4282bc8c6e2a service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4e5f23-19c7-428f-affe-5434ec17850b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:12:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:12:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9af7bee950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.046s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[305d3e18-e020-42b9-b7f0-206090699f1f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1d66bb-05d5-4236-ab91-39f9b224ba3c]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ff5b8-1fbc-4ca9-8376-b9d191aae8ad]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27a6d8e-1971-4f59-83e8-c166fc0bbb01]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[826cbc00-f1f6-4cc2-b2fe-49f139f8f728]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb4140-eb2a-4c6d-ae51-340bbc773713]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29, portal: 172.16.0.220,3260]
Aug 14 12:12:48 user nova-compute[73012]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29, portal: 172.16.0.220,3260] successful.
Aug 14 12:12:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.network.neutron [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Updated VIF entry in instance network info cache for port a3cb9338-9b9e-48ed-9da8-1cef3094170d. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.network.neutron [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Updating instance_info_cache with network_info: [{"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f5ea2f-fb71-4a59-b30b-8087d20eda29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fe6b8b-1e3d-4728-a50f-f0967fe9d0ab]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] <== disconnect_volume: return (408ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDrLjlUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:12:48 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Releasing lock "refresh_cache-0d1c12d3-8962-49e8-8ad5-071caee70b94" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:48 user nova-compute[73012]: WARNING nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-5e30ee37-0c0f-48b1-8719-f949bcf47c10 for instance with vm_state active and task_state deleting.
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-unplugged-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-63039d69-9348-496a-9acc-7a527f14c14d for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:48 user nova-compute[73012]: WARNING nova.compute.manager [req-83c67688-3d7a-4763-89bf-d15c6f7e1068 req-2f57340c-449f-4aee-ba1c-b8c602946c4c service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-63039d69-9348-496a-9acc-7a527f14c14d for instance with vm_state active and task_state deleting.
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5cc919-78cf-436a-bd46-0d4b426c2b99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e92881-38b3-42d3-bcf8-90d1477a6fd9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:12:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:48 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:12:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9af7bee950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0a196b-b192-48e2-a817-f80c8690f64f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a945296-a9ee-4350-b401-010d3e383172]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9315fee-2d4d-45d8-9353-555d4571829c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.165s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63f35d6-7d82-4a1f-891f-ac3f4e483914]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe09305d-5630-464d-aac0-241f38125fcf]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd3bb8-4fdd-43d8-90dc-f3c0ac256f2b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a, portal: 172.16.0.220,3260]
Aug 14 12:12:48 user nova-compute[73012]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a, portal: 172.16.0.220,3260] successful.
Aug 14 12:12:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d8081d7-762e-42a3-9656-0fd0ebf7ac8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b101b83e-4d3c-4171-9325-f38c7b3d725f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.525s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] <== disconnect_volume: return (526ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'erFBlGQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:12:49 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a8cf78-1ce9-4ea9-bfa1-47880d979670]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa22bda4-04bb-4cee-bbc4-09c96c21ddfc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:12:49 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e088d451-aaf6-456e-b954-b5a99334ea3a (non-flash)
Aug 14 12:12:49 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:12:49 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0123be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08'): ({'sde'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Removing single pathed devices sde {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:49 user nova-compute[73012]: WARNING nova.compute.manager [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-78c215c5-4cf9-407c-8f72-927553c1b299 for instance with vm_state active and task_state deleting.
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-unplugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-unplugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:49 user nova-compute[73012]: WARNING nova.compute.manager [req-2d092008-80b8-49b3-bb83-d71295caae58 req-9dc84fba-0def-427b-826c-28cdf6494e0d service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 for instance with vm_state active and task_state deleting.
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[773ca77a-1aea-4b77-9a4e-b875e6860c38]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[96320971-74fc-4a9c-8cfe-e1ddb6a1a9d7]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Flushing IO for device /dev/sde {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33cb03e-0b64-4956-b1df-7d6214517b93]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.139s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e5dab4-4d46-45fa-912d-2ca37e465497]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20dcb76-6163-47fc-a94b-48c78aa7e240]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7714e-7290-4086-be07-f7b50cdab332]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08, portal: 172.16.0.220,3260]
Aug 14 12:12:49 user nova-compute[73012]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08, portal: 172.16.0.220,3260] successful.
Aug 14 12:12:49 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b32a3-b7e5-41de-b018-2e1120de2f08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dc6ca8-8ffe-42ac-b3ce-a62b8a5b13c7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] <== disconnect_volume: return (492ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:12:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Deleting instance files /opt/stack/data/nova/instances/e2017069-2aa6-4cd0-b12f-16af7887b48b_del
Aug 14 12:12:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Deletion of /opt/stack/data/nova/instances/e2017069-2aa6-4cd0-b12f-16af7887b48b_del complete
Aug 14 12:12:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:49 user nova-compute[73012]: INFO nova.compute.manager [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Took 4.48 seconds to destroy the instance on the hypervisor.
Aug 14 12:12:49 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:12:49 user nova-compute[73012]: INFO nova.compute.manager [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Terminating instance
Aug 14 12:12:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-d2acfde8-0e87-4387-b73f-c858a57a77df req-54fe2439-f4ed-4290-95ff-f7812ae25515 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-plugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d2acfde8-0e87-4387-b73f-c858a57a77df req-54fe2439-f4ed-4290-95ff-f7812ae25515 service nova] Acquiring lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d2acfde8-0e87-4387-b73f-c858a57a77df req-54fe2439-f4ed-4290-95ff-f7812ae25515 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d2acfde8-0e87-4387-b73f-c858a57a77df req-54fe2439-f4ed-4290-95ff-f7812ae25515 service nova] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-d2acfde8-0e87-4387-b73f-c858a57a77df req-54fe2439-f4ed-4290-95ff-f7812ae25515 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] No waiting events found dispatching network-vif-plugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:50 user nova-compute[73012]: WARNING nova.compute.manager [req-d2acfde8-0e87-4387-b73f-c858a57a77df req-54fe2439-f4ed-4290-95ff-f7812ae25515 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received unexpected event network-vif-plugged-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 for instance with vm_state active and task_state deleting.
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-6be471d9-8b83-4bb8-9544-b97de4998b6e req-3805b9a4-aea8-43e3-926d-c7be16c41185 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-unplugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6be471d9-8b83-4bb8-9544-b97de4998b6e req-3805b9a4-aea8-43e3-926d-c7be16c41185 service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6be471d9-8b83-4bb8-9544-b97de4998b6e req-3805b9a4-aea8-43e3-926d-c7be16c41185 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6be471d9-8b83-4bb8-9544-b97de4998b6e req-3805b9a4-aea8-43e3-926d-c7be16c41185 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-6be471d9-8b83-4bb8-9544-b97de4998b6e req-3805b9a4-aea8-43e3-926d-c7be16c41185 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-unplugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-6be471d9-8b83-4bb8-9544-b97de4998b6e req-3805b9a4-aea8-43e3-926d-c7be16c41185 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-unplugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:12:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Instance destroyed successfully.
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lazy-loading 'resources' on Instance uuid 0d678d6a-ace6-4bcc-82af-29460c7c50cb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-378779457',display_name='tempest-ServerStableDeviceRescueTest-server-378779457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-378779457',id=3,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhPwP5jXF/tR02HIssrEdXCa5gf+IGiWLpoNdK1pkyrsEkL2aMd5/ngo3EGORwUePP8rJ9LK39XBThbw2MQLXGlgylxkAyRX5nJ7L3mlOPge3OrXCo4mIv/6zyBAhLeXQ==',key_name='tempest-keypair-1154628437',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b0b3f5808324dc1994b2264b2a2a878',ramdisk_id='',reservation_id='r-huxlepgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1299098448',owner_user_name='tempest-ServerStableDeviceRescueTest-1299098448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e558a10b41b4c9a9c232742b5cd3564',uuid=0d678d6a-ace6-4bcc-82af-29460c7c50cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Converting VIF {"id": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "address": "fa:16:3e:65:f8:c8", "network": {"id": "b6fdd206-2642-429e-8807-483e6d939a72", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1773534682-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b0b3f5808324dc1994b2264b2a2a878", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecbb2a3-6f", "ovs_interfaceid": "decbb2a3-6f5c-48e3-a1ef-ee8237584aeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:f8:c8,bridge_name='br-int',has_traffic_filtering=True,id=decbb2a3-6f5c-48e3-a1ef-ee8237584aeb,network=Network(b6fdd206-2642-429e-8807-483e6d939a72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbb2a3-6f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG os_vif [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:f8:c8,bridge_name='br-int',has_traffic_filtering=True,id=decbb2a3-6f5c-48e3-a1ef-ee8237584aeb,network=Network(b6fdd206-2642-429e-8807-483e6d939a72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbb2a3-6f') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdecbb2a3-6f, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:12:50 user nova-compute[73012]: INFO os_vif [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:f8:c8,bridge_name='br-int',has_traffic_filtering=True,id=decbb2a3-6f5c-48e3-a1ef-ee8237584aeb,network=Network(b6fdd206-2642-429e-8807-483e6d939a72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdecbb2a3-6f')
Aug 14 12:12:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Deleting instance files /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb_del
Aug 14 12:12:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Deletion of /opt/stack/data/nova/instances/0d678d6a-ace6-4bcc-82af-29460c7c50cb_del complete
Aug 14 12:12:50 user nova-compute[73012]: INFO nova.compute.manager [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 14 12:12:50 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:12:50 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:12:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] No waiting events found dispatching network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:51 user nova-compute[73012]: WARNING nova.compute.manager [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received unexpected event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d for instance with vm_state building and task_state spawning.
Aug 14 12:12:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] No waiting events found dispatching network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:51 user nova-compute[73012]: WARNING nova.compute.manager [req-025b3069-48a3-47dd-a7ff-23f9d78d3a8f req-541026ce-32a4-4f5b-b0b7-fbdf13870e67 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received unexpected event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d for instance with vm_state building and task_state spawning.
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015172.1476657, 0d1c12d3-8962-49e8-8ad5-071caee70b94 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:52 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] VM Resumed (Lifecycle Event)
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:12:52 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Instance spawned successfully.
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:12:52 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015172.1526177, 0d1c12d3-8962-49e8-8ad5-071caee70b94 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:12:52 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] VM Started (Lifecycle Event)
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:12:52 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:12:52 user nova-compute[73012]: INFO nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Took 11.80 seconds to spawn the instance on the hypervisor.
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:12:52 user nova-compute[73012]: INFO nova.compute.manager [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Took 13.00 seconds to build instance.
Aug 14 12:12:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9e9a5484-205b-492c-9c68-b953b90c9238 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.148s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-2147bbeb-f17a-4332-8e06-7cd26088719d req-1b7deb9e-e5c7-49e4-b0b8-bc1ff27e43f2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2147bbeb-f17a-4332-8e06-7cd26088719d req-1b7deb9e-e5c7-49e4-b0b8-bc1ff27e43f2 service nova] Acquiring lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2147bbeb-f17a-4332-8e06-7cd26088719d req-1b7deb9e-e5c7-49e4-b0b8-bc1ff27e43f2 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2147bbeb-f17a-4332-8e06-7cd26088719d req-1b7deb9e-e5c7-49e4-b0b8-bc1ff27e43f2 service nova] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-2147bbeb-f17a-4332-8e06-7cd26088719d req-1b7deb9e-e5c7-49e4-b0b8-bc1ff27e43f2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] No waiting events found dispatching network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:12:52 user nova-compute[73012]: WARNING nova.compute.manager [req-2147bbeb-f17a-4332-8e06-7cd26088719d req-1b7deb9e-e5c7-49e4-b0b8-bc1ff27e43f2 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received unexpected event network-vif-plugged-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb for instance with vm_state active and task_state deleting.
Aug 14 12:12:53 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:53 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Took 3.04 seconds to deallocate network for instance.
Aug 14 12:12:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:54 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:12:54 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:12:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:54 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Deleted allocations for instance 0d678d6a-ace6-4bcc-82af-29460c7c50cb
Aug 14 12:12:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46d66468-7a37-4f42-8df7-8463cac57a16 tempest-ServerStableDeviceRescueTest-1299098448 tempest-ServerStableDeviceRescueTest-1299098448-project-member] Lock "0d678d6a-ace6-4bcc-82af-29460c7c50cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.788s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-9d7aca4a-9e50-4f7e-bff6-6c429b9f1d5e req-29b2198d-c83d-498a-9a03-08b8d8299ed3 service nova] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Received event network-vif-deleted-decbb2a3-6f5c-48e3-a1ef-ee8237584aeb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:12:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-50dd86d4-229a-41ba-ba89-78723a3de5e6 req-300998a6-b4f3-4744-b15d-d6e841a5b655 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-deleted-1e22b2f7-3b42-40bd-9cf5-c64e63eeb001 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:56 user nova-compute[73012]: INFO nova.compute.manager [req-50dd86d4-229a-41ba-ba89-78723a3de5e6 req-300998a6-b4f3-4744-b15d-d6e841a5b655 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Neutron deleted interface 1e22b2f7-3b42-40bd-9cf5-c64e63eeb001; detaching it from the instance and deleting it from the info cache
Aug 14 12:12:56 user nova-compute[73012]: DEBUG nova.network.neutron [req-50dd86d4-229a-41ba-ba89-78723a3de5e6 req-300998a6-b4f3-4744-b15d-d6e841a5b655 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [{"id": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "address": "fa:16:3e:78:f5:72", "network": {"id": "674aed60-730e-4e10-a46b-ac3b156cd2c5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1849733859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e30ee37-0c", "ovs_interfaceid": "5e30ee37-0c0f-48b1-8719-f949bcf47c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-50dd86d4-229a-41ba-ba89-78723a3de5e6 req-300998a6-b4f3-4744-b15d-d6e841a5b655 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Detach interface failed, port_id=1e22b2f7-3b42-40bd-9cf5-c64e63eeb001, reason: Instance e2017069-2aa6-4cd0-b12f-16af7887b48b could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:12:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-50dd86d4-229a-41ba-ba89-78723a3de5e6 req-300998a6-b4f3-4744-b15d-d6e841a5b655 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-deleted-5e30ee37-0c0f-48b1-8719-f949bcf47c10 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:56 user nova-compute[73012]: INFO nova.compute.manager [req-50dd86d4-229a-41ba-ba89-78723a3de5e6 req-300998a6-b4f3-4744-b15d-d6e841a5b655 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Neutron deleted interface 5e30ee37-0c0f-48b1-8719-f949bcf47c10; detaching it from the instance and deleting it from the info cache
Aug 14 12:12:56 user nova-compute[73012]: DEBUG nova.network.neutron [req-50dd86d4-229a-41ba-ba89-78723a3de5e6 req-300998a6-b4f3-4744-b15d-d6e841a5b655 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [{"id": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "address": "fa:16:3e:c4:07:6c", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f3ff54-10", "ovs_interfaceid": "94f3ff54-1015-4d97-a5d8-1700aa55cd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "address": "fa:16:3e:c6:ee:bc", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0b4a4d-6d", "ovs_interfaceid": "ed0b4a4d-6df3-4a44-a9b2-b8a549dc8019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63039d69-9348-496a-9acc-7a527f14c14d", "address": "fa:16:3e:97:6d:13", "network": {"id": "bae7fbd7-63a1-4e14-82d7-7e4db3606163", "bridge": "br-int", "label": "tempest-device-tagging-net1-687196780", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63039d69-93", "ovs_interfaceid": "63039d69-9348-496a-9acc-7a527f14c14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78c215c5-4cf9-407c-8f72-927553c1b299", "address": "fa:16:3e:44:d8:0b", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c215c5-4c", "ovs_interfaceid": "78c215c5-4cf9-407c-8f72-927553c1b299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "address": "fa:16:3e:61:27:4c", "network": {"id": "acf10702-b100-41cd-a3ea-d42655563289", "bridge": "br-int", "label": "tempest-device-tagging-net2-354665968", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5e0f9d241b964ed3a36a9bb4b590ef6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f01a68-a0", "ovs_interfaceid": "f1f01a68-a0eb-4d18-8d8d-80097ae41d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-50dd86d4-229a-41ba-ba89-78723a3de5e6 req-300998a6-b4f3-4744-b15d-d6e841a5b655 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Detach interface failed, port_id=5e30ee37-0c0f-48b1-8719-f949bcf47c10, reason: Instance e2017069-2aa6-4cd0-b12f-16af7887b48b could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:12:57 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:12:57 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Took 8.21 seconds to deallocate network for instance.
Aug 14 12:12:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-60f6a28b-b34a-47ae-b2e3-ae0198960f72 req-0514e469-96d7-4b74-adef-cbdb2c07f569 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-deleted-f1f01a68-a0eb-4d18-8d8d-80097ae41d56 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-60f6a28b-b34a-47ae-b2e3-ae0198960f72 req-0514e469-96d7-4b74-adef-cbdb2c07f569 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-deleted-78c215c5-4cf9-407c-8f72-927553c1b299 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-60f6a28b-b34a-47ae-b2e3-ae0198960f72 req-0514e469-96d7-4b74-adef-cbdb2c07f569 service nova] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Received event network-vif-deleted-63039d69-9348-496a-9acc-7a527f14c14d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:12:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:12:59 user nova-compute[73012]: INFO nova.compute.claims [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Claim successful on node user
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:12:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.policy [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7648caa38d8e4de6bf9751a512ffb14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b522100e4bf447e3b544983c451c3786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:12:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Creating image(s)
Aug 14 12:12:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:12:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.224s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.208s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk 1073741824" returned: 0 in 0.061s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Successfully created port: c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.229s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:00 user nova-compute[73012]: INFO nova.compute.manager [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Took 2.99 seconds to detach 3 volumes for instance.
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Cannot resize image /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'migration_context' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Ensure instance console log exists: /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:01 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Deleted allocations for instance e2017069-2aa6-4cd0-b12f-16af7887b48b
Aug 14 12:13:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-efadc54a-0525-4c8b-af7b-f366fd08e861 tempest-TaggedBootDevicesTest_v242-2061817737 tempest-TaggedBootDevicesTest_v242-2061817737-project-member] Lock "e2017069-2aa6-4cd0-b12f-16af7887b48b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.318s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Successfully updated port: c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquired lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-69b3344b-169d-49d3-94a8-23337366a064 req-45761ef1-8ce2-49f6-9665-fe13f2253609 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-changed-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-69b3344b-169d-49d3-94a8-23337366a064 req-45761ef1-8ce2-49f6-9665-fe13f2253609 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Refreshing instance network info cache due to event network-changed-c652878c-a896-4c3f-8108-ec1157747dd8. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-69b3344b-169d-49d3-94a8-23337366a064 req-45761ef1-8ce2-49f6-9665-fe13f2253609 service nova] Acquiring lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating instance_info_cache with network_info: [{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Releasing lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance network_info: |[{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-69b3344b-169d-49d3-94a8-23337366a064 req-45761ef1-8ce2-49f6-9665-fe13f2253609 service nova] Acquired lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:13:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-69b3344b-169d-49d3-94a8-23337366a064 req-45761ef1-8ce2-49f6-9665-fe13f2253609 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Refreshing network info cache for port c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Start _get_guest_xml network_info=[{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:13:02 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:13:02 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-838748235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-838748235',id=22,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV5mRNytxsnHEHhX2uJ4TIFUR6h3MrD/JjWu07t8+cOMMt8KeSmdhu7LxlHAmPyRFLqS8Z5Vg9nlht/gXkJmEiwnTatdpAZwx6xjN1iITv9/VgSvjTaPrb/5C0hzuXLmg==',key_name='tempest-keypair-859094030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-f2gn3cvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=cfa2f996-7907-4490-84d6-c04c5d0ca6e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'pci_devices' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:13:02 user nova-compute[73012]:   <uuid>cfa2f996-7907-4490-84d6-c04c5d0ca6e5</uuid>
Aug 14 12:13:02 user nova-compute[73012]:   <name>instance-00000016</name>
Aug 14 12:13:02 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:13:02 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:13:02 user nova-compute[73012]:   <metadata>
Aug 14 12:13:02 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:13:02 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:13:02 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-838748235</nova:name>
Aug 14 12:13:02 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:13:02</nova:creationTime>
Aug 14 12:13:02 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:13:02 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:13:02 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:13:02 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:13:02 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:13:02 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:13:02 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:13:02 user nova-compute[73012]:       <nova:owner>
Aug 14 12:13:02 user nova-compute[73012]:         <nova:user uuid="7648caa38d8e4de6bf9751a512ffb14a">tempest-AttachVolumeShelveTestJSON-192114773-project-member</nova:user>
Aug 14 12:13:02 user nova-compute[73012]:         <nova:project uuid="b522100e4bf447e3b544983c451c3786">tempest-AttachVolumeShelveTestJSON-192114773</nova:project>
Aug 14 12:13:02 user nova-compute[73012]:       </nova:owner>
Aug 14 12:13:02 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:13:02 user nova-compute[73012]:       <nova:ports>
Aug 14 12:13:02 user nova-compute[73012]:         <nova:port uuid="c652878c-a896-4c3f-8108-ec1157747dd8">
Aug 14 12:13:02 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:13:02 user nova-compute[73012]:         </nova:port>
Aug 14 12:13:02 user nova-compute[73012]:       </nova:ports>
Aug 14 12:13:02 user nova-compute[73012]:     </nova:instance>
Aug 14 12:13:02 user nova-compute[73012]:   </metadata>
Aug 14 12:13:02 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:13:02 user nova-compute[73012]:     <system>
Aug 14 12:13:02 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:13:02 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:13:02 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:13:02 user nova-compute[73012]:       <entry name="serial">cfa2f996-7907-4490-84d6-c04c5d0ca6e5</entry>
Aug 14 12:13:02 user nova-compute[73012]:       <entry name="uuid">cfa2f996-7907-4490-84d6-c04c5d0ca6e5</entry>
Aug 14 12:13:02 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:13:02 user nova-compute[73012]:     </system>
Aug 14 12:13:02 user nova-compute[73012]:   </sysinfo>
Aug 14 12:13:02 user nova-compute[73012]:   <os>
Aug 14 12:13:02 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:13:02 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:13:02 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:13:02 user nova-compute[73012]:   </os>
Aug 14 12:13:02 user nova-compute[73012]:   <features>
Aug 14 12:13:02 user nova-compute[73012]:     <acpi/>
Aug 14 12:13:02 user nova-compute[73012]:     <apic/>
Aug 14 12:13:02 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:13:02 user nova-compute[73012]:   </features>
Aug 14 12:13:02 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:13:02 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:13:02 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:13:02 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:13:02 user nova-compute[73012]:   </clock>
Aug 14 12:13:02 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:13:02 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:13:02 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:13:02 user nova-compute[73012]:   </cpu>
Aug 14 12:13:02 user nova-compute[73012]:   <devices>
Aug 14 12:13:02 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:13:02 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:13:02 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk"/>
Aug 14 12:13:02 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:13:02 user nova-compute[73012]:     </disk>
Aug 14 12:13:02 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:13:02 user nova-compute[73012]:       <mac address="fa:16:3e:8d:6f:90"/>
Aug 14 12:13:02 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:13:02 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:13:02 user nova-compute[73012]:       <target dev="tapc652878c-a8"/>
Aug 14 12:13:02 user nova-compute[73012]:     </interface>
Aug 14 12:13:02 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:13:02 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/console.log" append="off"/>
Aug 14 12:13:02 user nova-compute[73012]:     </serial>
Aug 14 12:13:02 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:13:02 user nova-compute[73012]:     <video>
Aug 14 12:13:02 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:13:02 user nova-compute[73012]:     </video>
Aug 14 12:13:02 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:13:02 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:13:02 user nova-compute[73012]:     </rng>
Aug 14 12:13:02 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:13:02 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:13:02 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:13:02 user nova-compute[73012]:     </memballoon>
Aug 14 12:13:02 user nova-compute[73012]:   </devices>
Aug 14 12:13:02 user nova-compute[73012]: </domain>
Aug 14 12:13:02 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-838748235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-838748235',id=22,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV5mRNytxsnHEHhX2uJ4TIFUR6h3MrD/JjWu07t8+cOMMt8KeSmdhu7LxlHAmPyRFLqS8Z5Vg9nlht/gXkJmEiwnTatdpAZwx6xjN1iITv9/VgSvjTaPrb/5C0hzuXLmg==',key_name='tempest-keypair-859094030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-f2gn3cvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=cfa2f996-7907-4490-84d6-c04c5d0ca6e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG os_vif [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc652878c-a8, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc652878c-a8, col_values=(('external_ids', {'iface-id': 'c652878c-a896-4c3f-8108-ec1157747dd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:6f:90', 'vm-uuid': 'cfa2f996-7907-4490-84d6-c04c5d0ca6e5'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:02 user nova-compute[73012]: INFO os_vif [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8')
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] No VIF found with MAC fa:16:3e:8d:6f:90, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015167.4346514, e2017069-2aa6-4cd0-b12f-16af7887b48b => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:13:02 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] VM Stopped (Lifecycle Event)
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-250b9927-c8ed-4f3b-8b47-7e2cf9f8f451 None None] [instance: e2017069-2aa6-4cd0-b12f-16af7887b48b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-69b3344b-169d-49d3-94a8-23337366a064 req-45761ef1-8ce2-49f6-9665-fe13f2253609 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updated VIF entry in instance network info cache for port c652878c-a896-4c3f-8108-ec1157747dd8. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-69b3344b-169d-49d3-94a8-23337366a064 req-45761ef1-8ce2-49f6-9665-fe13f2253609 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating instance_info_cache with network_info: [{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:13:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-69b3344b-169d-49d3-94a8-23337366a064 req-45761ef1-8ce2-49f6-9665-fe13f2253609 service nova] Releasing lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:13:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:05 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015170.559687, 0d678d6a-ace6-4bcc-82af-29460c7c50cb => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:13:05 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] VM Stopped (Lifecycle Event)
Aug 14 12:13:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-323f91a6-5799-490e-b95a-38a1a0c4f5d7 None None] [instance: 0d678d6a-ace6-4bcc-82af-29460c7c50cb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:13:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-0695220c-e90b-4022-92e8-5545e359fb6d req-93409a74-f8c1-4ad0-b3e5-47fbd30bc081 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0695220c-e90b-4022-92e8-5545e359fb6d req-93409a74-f8c1-4ad0-b3e5-47fbd30bc081 service nova] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0695220c-e90b-4022-92e8-5545e359fb6d req-93409a74-f8c1-4ad0-b3e5-47fbd30bc081 service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0695220c-e90b-4022-92e8-5545e359fb6d req-93409a74-f8c1-4ad0-b3e5-47fbd30bc081 service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-0695220c-e90b-4022-92e8-5545e359fb6d req-93409a74-f8c1-4ad0-b3e5-47fbd30bc081 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] No waiting events found dispatching network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:05 user nova-compute[73012]: WARNING nova.compute.manager [req-0695220c-e90b-4022-92e8-5545e359fb6d req-93409a74-f8c1-4ad0-b3e5-47fbd30bc081 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received unexpected event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 for instance with vm_state building and task_state spawning.
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015186.5115175, cfa2f996-7907-4490-84d6-c04c5d0ca6e5 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:13:06 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] VM Resumed (Lifecycle Event)
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:13:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance spawned successfully.
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:06 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015186.5124044, cfa2f996-7907-4490-84d6-c04c5d0ca6e5 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:13:06 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] VM Started (Lifecycle Event)
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:13:06 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:13:06 user nova-compute[73012]: INFO nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Took 6.69 seconds to spawn the instance on the hypervisor.
Aug 14 12:13:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:13:06 user nova-compute[73012]: INFO nova.compute.manager [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Took 7.68 seconds to build instance.
Aug 14 12:13:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7fb128b2-e7c5-493a-b6bc-9c5af9443173 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.797s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "85d8779d-a30a-46ea-b979-860584678597" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "85d8779d-a30a-46ea-b979-860584678597" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:13:07 user nova-compute[73012]: INFO nova.compute.claims [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Claim successful on node user
Aug 14 12:13:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-0c981009-0881-44e7-a4ee-e3d1c2def16e req-89cf6011-59d0-44a1-8782-787c960b1a9d service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0c981009-0881-44e7-a4ee-e3d1c2def16e req-89cf6011-59d0-44a1-8782-787c960b1a9d service nova] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0c981009-0881-44e7-a4ee-e3d1c2def16e req-89cf6011-59d0-44a1-8782-787c960b1a9d service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0c981009-0881-44e7-a4ee-e3d1c2def16e req-89cf6011-59d0-44a1-8782-787c960b1a9d service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-0c981009-0881-44e7-a4ee-e3d1c2def16e req-89cf6011-59d0-44a1-8782-787c960b1a9d service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] No waiting events found dispatching network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:07 user nova-compute[73012]: WARNING nova.compute.manager [req-0c981009-0881-44e7-a4ee-e3d1c2def16e req-89cf6011-59d0-44a1-8782-787c960b1a9d service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received unexpected event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 for instance with vm_state active and task_state None.
Aug 14 12:13:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:13:07 user nova-compute[73012]: DEBUG nova.network.neutron [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:13:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.policy [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae1ce3345617447486642ebe88c1621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1960abc96445f483386773f67d83e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:13:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Creating image(s)
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "/opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "/opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "/opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk 1073741824" returned: 0 in 0.049s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Successfully created port: d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Cannot resize image /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.objects.instance [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'migration_context' on Instance uuid 85d8779d-a30a-46ea-b979-860584678597 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Ensure instance console log exists: /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Successfully updated port: d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:13:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:13:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquired lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:13:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:13:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-a38f102e-4b71-414f-ad9d-7a165cd25f00 req-546d395c-7fa9-4687-b88f-167039fddc3f service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received event network-changed-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-a38f102e-4b71-414f-ad9d-7a165cd25f00 req-546d395c-7fa9-4687-b88f-167039fddc3f service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Refreshing instance network info cache due to event network-changed-d7f8f436-6585-4530-bb5a-e03ec969514b. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:13:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a38f102e-4b71-414f-ad9d-7a165cd25f00 req-546d395c-7fa9-4687-b88f-167039fddc3f service nova] Acquiring lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:13:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updating instance_info_cache with network_info: [{"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Releasing lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Instance network_info: |[{"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a38f102e-4b71-414f-ad9d-7a165cd25f00 req-546d395c-7fa9-4687-b88f-167039fddc3f service nova] Acquired lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-a38f102e-4b71-414f-ad9d-7a165cd25f00 req-546d395c-7fa9-4687-b88f-167039fddc3f service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Refreshing network info cache for port d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Start _get_guest_xml network_info=[{"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:13:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:13:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1356726673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1356726673',id=23,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-8wiheeu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:13:08Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=85d8779d-a30a-46ea-b979-860584678597,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:d1:79,bridge_name='br-int',has_traffic_filtering=True,id=d7f8f436-6585-4530-bb5a-e03ec969514b,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f8f436-65') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.objects.instance [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'pci_devices' on Instance uuid 85d8779d-a30a-46ea-b979-860584678597 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:13:10 user nova-compute[73012]:   <uuid>85d8779d-a30a-46ea-b979-860584678597</uuid>
Aug 14 12:13:10 user nova-compute[73012]:   <name>instance-00000017</name>
Aug 14 12:13:10 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:13:10 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:13:10 user nova-compute[73012]:   <metadata>
Aug 14 12:13:10 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:13:10 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:13:10 user nova-compute[73012]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1356726673</nova:name>
Aug 14 12:13:10 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:13:10</nova:creationTime>
Aug 14 12:13:10 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:13:10 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:13:10 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:13:10 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:13:10 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:13:10 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:13:10 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:13:10 user nova-compute[73012]:       <nova:owner>
Aug 14 12:13:10 user nova-compute[73012]:         <nova:user uuid="ae1ce3345617447486642ebe88c1621c">tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member</nova:user>
Aug 14 12:13:10 user nova-compute[73012]:         <nova:project uuid="6b1960abc96445f483386773f67d83e3">tempest-ServerBootFromVolumeStableRescueTest-1756944789</nova:project>
Aug 14 12:13:10 user nova-compute[73012]:       </nova:owner>
Aug 14 12:13:10 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:13:10 user nova-compute[73012]:       <nova:ports>
Aug 14 12:13:10 user nova-compute[73012]:         <nova:port uuid="d7f8f436-6585-4530-bb5a-e03ec969514b">
Aug 14 12:13:10 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 12:13:10 user nova-compute[73012]:         </nova:port>
Aug 14 12:13:10 user nova-compute[73012]:       </nova:ports>
Aug 14 12:13:10 user nova-compute[73012]:     </nova:instance>
Aug 14 12:13:10 user nova-compute[73012]:   </metadata>
Aug 14 12:13:10 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:13:10 user nova-compute[73012]:     <system>
Aug 14 12:13:10 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:13:10 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:13:10 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:13:10 user nova-compute[73012]:       <entry name="serial">85d8779d-a30a-46ea-b979-860584678597</entry>
Aug 14 12:13:10 user nova-compute[73012]:       <entry name="uuid">85d8779d-a30a-46ea-b979-860584678597</entry>
Aug 14 12:13:10 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:13:10 user nova-compute[73012]:     </system>
Aug 14 12:13:10 user nova-compute[73012]:   </sysinfo>
Aug 14 12:13:10 user nova-compute[73012]:   <os>
Aug 14 12:13:10 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:13:10 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:13:10 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:13:10 user nova-compute[73012]:   </os>
Aug 14 12:13:10 user nova-compute[73012]:   <features>
Aug 14 12:13:10 user nova-compute[73012]:     <acpi/>
Aug 14 12:13:10 user nova-compute[73012]:     <apic/>
Aug 14 12:13:10 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:13:10 user nova-compute[73012]:   </features>
Aug 14 12:13:10 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:13:10 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:13:10 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:13:10 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:13:10 user nova-compute[73012]:   </clock>
Aug 14 12:13:10 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:13:10 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:13:10 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:13:10 user nova-compute[73012]:   </cpu>
Aug 14 12:13:10 user nova-compute[73012]:   <devices>
Aug 14 12:13:10 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:13:10 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:13:10 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk"/>
Aug 14 12:13:10 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:13:10 user nova-compute[73012]:     </disk>
Aug 14 12:13:10 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:13:10 user nova-compute[73012]:       <mac address="fa:16:3e:89:d1:79"/>
Aug 14 12:13:10 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:13:10 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:13:10 user nova-compute[73012]:       <target dev="tapd7f8f436-65"/>
Aug 14 12:13:10 user nova-compute[73012]:     </interface>
Aug 14 12:13:10 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:13:10 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/console.log" append="off"/>
Aug 14 12:13:10 user nova-compute[73012]:     </serial>
Aug 14 12:13:10 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:13:10 user nova-compute[73012]:     <video>
Aug 14 12:13:10 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:13:10 user nova-compute[73012]:     </video>
Aug 14 12:13:10 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:13:10 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:13:10 user nova-compute[73012]:     </rng>
Aug 14 12:13:10 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:13:10 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:13:10 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:13:10 user nova-compute[73012]:     </memballoon>
Aug 14 12:13:10 user nova-compute[73012]:   </devices>
Aug 14 12:13:10 user nova-compute[73012]: </domain>
Aug 14 12:13:10 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1356726673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1356726673',id=23,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-8wiheeu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:13:08Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=85d8779d-a30a-46ea-b979-860584678597,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:d1:79,bridge_name='br-int',has_traffic_filtering=True,id=d7f8f436-6585-4530-bb5a-e03ec969514b,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f8f436-65') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG os_vif [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:d1:79,bridge_name='br-int',has_traffic_filtering=True,id=d7f8f436-6585-4530-bb5a-e03ec969514b,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f8f436-65') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7f8f436-65, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7f8f436-65, col_values=(('external_ids', {'iface-id': 'd7f8f436-6585-4530-bb5a-e03ec969514b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:d1:79', 'vm-uuid': '85d8779d-a30a-46ea-b979-860584678597'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:10 user nova-compute[73012]: INFO os_vif [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:d1:79,bridge_name='br-int',has_traffic_filtering=True,id=d7f8f436-6585-4530-bb5a-e03ec969514b,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f8f436-65')
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No VIF found with MAC fa:16:3e:89:d1:79, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-a38f102e-4b71-414f-ad9d-7a165cd25f00 req-546d395c-7fa9-4687-b88f-167039fddc3f service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updated VIF entry in instance network info cache for port d7f8f436-6585-4530-bb5a-e03ec969514b. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-a38f102e-4b71-414f-ad9d-7a165cd25f00 req-546d395c-7fa9-4687-b88f-167039fddc3f service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updating instance_info_cache with network_info: [{"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:13:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a38f102e-4b71-414f-ad9d-7a165cd25f00 req-546d395c-7fa9-4687-b88f-167039fddc3f service nova] Releasing lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:13:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-f686b733-6372-4d70-abc7-f26fb91e2d0e req-9f6e2eda-817b-4285-b4bc-da358960a354 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received event network-vif-plugged-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f686b733-6372-4d70-abc7-f26fb91e2d0e req-9f6e2eda-817b-4285-b4bc-da358960a354 service nova] Acquiring lock "85d8779d-a30a-46ea-b979-860584678597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f686b733-6372-4d70-abc7-f26fb91e2d0e req-9f6e2eda-817b-4285-b4bc-da358960a354 service nova] Lock "85d8779d-a30a-46ea-b979-860584678597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f686b733-6372-4d70-abc7-f26fb91e2d0e req-9f6e2eda-817b-4285-b4bc-da358960a354 service nova] Lock "85d8779d-a30a-46ea-b979-860584678597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-f686b733-6372-4d70-abc7-f26fb91e2d0e req-9f6e2eda-817b-4285-b4bc-da358960a354 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] No waiting events found dispatching network-vif-plugged-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:12 user nova-compute[73012]: WARNING nova.compute.manager [req-f686b733-6372-4d70-abc7-f26fb91e2d0e req-9f6e2eda-817b-4285-b4bc-da358960a354 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received unexpected event network-vif-plugged-d7f8f436-6585-4530-bb5a-e03ec969514b for instance with vm_state building and task_state spawning.
Aug 14 12:13:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015194.0767045, 85d8779d-a30a-46ea-b979-860584678597 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:13:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] VM Resumed (Lifecycle Event)
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-dcfb2482-9e93-467b-95c8-66f399d1f6e3 req-c11a3883-698b-49c9-9cb3-b5e7f5b72125 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received event network-vif-plugged-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dcfb2482-9e93-467b-95c8-66f399d1f6e3 req-c11a3883-698b-49c9-9cb3-b5e7f5b72125 service nova] Acquiring lock "85d8779d-a30a-46ea-b979-860584678597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dcfb2482-9e93-467b-95c8-66f399d1f6e3 req-c11a3883-698b-49c9-9cb3-b5e7f5b72125 service nova] Lock "85d8779d-a30a-46ea-b979-860584678597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dcfb2482-9e93-467b-95c8-66f399d1f6e3 req-c11a3883-698b-49c9-9cb3-b5e7f5b72125 service nova] Lock "85d8779d-a30a-46ea-b979-860584678597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-dcfb2482-9e93-467b-95c8-66f399d1f6e3 req-c11a3883-698b-49c9-9cb3-b5e7f5b72125 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] No waiting events found dispatching network-vif-plugged-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:14 user nova-compute[73012]: WARNING nova.compute.manager [req-dcfb2482-9e93-467b-95c8-66f399d1f6e3 req-c11a3883-698b-49c9-9cb3-b5e7f5b72125 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received unexpected event network-vif-plugged-d7f8f436-6585-4530-bb5a-e03ec969514b for instance with vm_state building and task_state spawning.
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:13:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 85d8779d-a30a-46ea-b979-860584678597] Instance spawned successfully.
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:13:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015194.077556, 85d8779d-a30a-46ea-b979-860584678597 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:13:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] VM Started (Lifecycle Event)
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:13:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:13:14 user nova-compute[73012]: INFO nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 14 12:13:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:13:14 user nova-compute[73012]: INFO nova.compute.manager [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Took 6.93 seconds to build instance.
Aug 14 12:13:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58ce2332-eb69-4daa-b4e5-95275f073691 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "85d8779d-a30a-46ea-b979-860584678597" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.013s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-05cfaec7-c27f-44fe-8007-c821ab6673c3 req-12f94fbb-56a0-4cea-a712-9574ce250638 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-changed-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-05cfaec7-c27f-44fe-8007-c821ab6673c3 req-12f94fbb-56a0-4cea-a712-9574ce250638 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing instance network info cache due to event network-changed-8f766834-3616-4cde-a637-1e69ea30b119. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:13:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-05cfaec7-c27f-44fe-8007-c821ab6673c3 req-12f94fbb-56a0-4cea-a712-9574ce250638 service nova] Acquiring lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:13:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-05cfaec7-c27f-44fe-8007-c821ab6673c3 req-12f94fbb-56a0-4cea-a712-9574ce250638 service nova] Acquired lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:13:29 user nova-compute[73012]: DEBUG nova.network.neutron [req-05cfaec7-c27f-44fe-8007-c821ab6673c3 req-12f94fbb-56a0-4cea-a712-9574ce250638 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Refreshing network info cache for port 8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:13:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:30 user nova-compute[73012]: DEBUG nova.network.neutron [req-05cfaec7-c27f-44fe-8007-c821ab6673c3 req-12f94fbb-56a0-4cea-a712-9574ce250638 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updated VIF entry in instance network info cache for port 8f766834-3616-4cde-a637-1e69ea30b119. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:13:30 user nova-compute[73012]: DEBUG nova.network.neutron [req-05cfaec7-c27f-44fe-8007-c821ab6673c3 req-12f94fbb-56a0-4cea-a712-9574ce250638 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [{"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:13:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-05cfaec7-c27f-44fe-8007-c821ab6673c3 req-12f94fbb-56a0-4cea-a712-9574ce250638 service nova] Releasing lock "refresh_cache-427440ec-266a-41ab-b7e8-8d4f193d3671" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:13:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:30 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:30 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:13:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:32 user nova-compute[73012]: INFO nova.compute.manager [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Terminating instance
Aug 14 12:13:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-d62bc8a7-cb1b-461e-b771-c19ee8e22159 req-3a5197b0-f2b4-43a0-96e5-6d9a63271aa6 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d62bc8a7-cb1b-461e-b771-c19ee8e22159 req-3a5197b0-f2b4-43a0-96e5-6d9a63271aa6 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d62bc8a7-cb1b-461e-b771-c19ee8e22159 req-3a5197b0-f2b4-43a0-96e5-6d9a63271aa6 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d62bc8a7-cb1b-461e-b771-c19ee8e22159 req-3a5197b0-f2b4-43a0-96e5-6d9a63271aa6 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-d62bc8a7-cb1b-461e-b771-c19ee8e22159 req-3a5197b0-f2b4-43a0-96e5-6d9a63271aa6 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-unplugged-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-d62bc8a7-cb1b-461e-b771-c19ee8e22159 req-3a5197b0-f2b4-43a0-96e5-6d9a63271aa6 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-8f766834-3616-4cde-a637-1e69ea30b119 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-bfed6ac6-c3ef-4b17-94ca-53d83d4ea206 req-52447400-a202-4a14-95fc-9511b3cf2712 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bfed6ac6-c3ef-4b17-94ca-53d83d4ea206 req-52447400-a202-4a14-95fc-9511b3cf2712 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bfed6ac6-c3ef-4b17-94ca-53d83d4ea206 req-52447400-a202-4a14-95fc-9511b3cf2712 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bfed6ac6-c3ef-4b17-94ca-53d83d4ea206 req-52447400-a202-4a14-95fc-9511b3cf2712 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-bfed6ac6-c3ef-4b17-94ca-53d83d4ea206 req-52447400-a202-4a14-95fc-9511b3cf2712 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-unplugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-bfed6ac6-c3ef-4b17-94ca-53d83d4ea206 req-52447400-a202-4a14-95fc-9511b3cf2712 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updating instance_info_cache with network_info: [{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Instance destroyed successfully.
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.objects.instance [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lazy-loading 'resources' on Instance uuid 427440ec-266a-41ab-b7e8-8d4f193d3671 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "8f766834-3616-4cde-a637-1e69ea30b119", "address": "fa:16:3e:fa:44:85", "network": {"id": "ebdcd18a-4d47-49ef-9fd4-8bc89527bee3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-239304916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f766834-36", "ovs_interfaceid": "8f766834-3616-4cde-a637-1e69ea30b119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:44:85,bridge_name='br-int',has_traffic_filtering=True,id=8f766834-3616-4cde-a637-1e69ea30b119,network=Network(ebdcd18a-4d47-49ef-9fd4-8bc89527bee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f766834-36') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:44:85,bridge_name='br-int',has_traffic_filtering=True,id=8f766834-3616-4cde-a637-1e69ea30b119,network=Network(ebdcd18a-4d47-49ef-9fd4-8bc89527bee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f766834-36') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f766834-36, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: INFO os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:44:85,bridge_name='br-int',has_traffic_filtering=True,id=8f766834-3616-4cde-a637-1e69ea30b119,network=Network(ebdcd18a-4d47-49ef-9fd4-8bc89527bee3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f766834-36')
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=0e772e4c-640f-4440-83db-edd3ce27c7f8,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e772e4c-64') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=0e772e4c-640f-4440-83db-edd3ce27c7f8,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e772e4c-64') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e772e4c-64, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: INFO os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=0e772e4c-640f-4440-83db-edd3ce27c7f8,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0e772e4c-64')
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=3e2365da-a29b-45bf-bea0-5f20cb9a07e5,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e2365da-a2') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=3e2365da-a29b-45bf-bea0-5f20cb9a07e5,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e2365da-a2') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e2365da-a2, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:34 user nova-compute[73012]: INFO os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:0f,bridge_name='br-int',has_traffic_filtering=True,id=3e2365da-a29b-45bf-bea0-5f20cb9a07e5,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e2365da-a2')
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:17:a3,bridge_name='br-int',has_traffic_filtering=True,id=01f3ceea-f399-418f-a617-d60a5734079a,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f3ceea-f3') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:17:a3,bridge_name='br-int',has_traffic_filtering=True,id=01f3ceea-f399-418f-a617-d60a5734079a,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f3ceea-f3') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01f3ceea-f3, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:34 user nova-compute[73012]: INFO os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:17:a3,bridge_name='br-int',has_traffic_filtering=True,id=01f3ceea-f399-418f-a617-d60a5734079a,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f3ceea-f3')
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:25:90,bridge_name='br-int',has_traffic_filtering=True,id=ce2a4787-3b7d-490d-a9c2-65558de32504,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2a4787-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:25:90,bridge_name='br-int',has_traffic_filtering=True,id=ce2a4787-3b7d-490d-a9c2-65558de32504,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2a4787-3b') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce2a4787-3b, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:34 user nova-compute[73012]: INFO os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:25:90,bridge_name='br-int',has_traffic_filtering=True,id=ce2a4787-3b7d-490d-a9c2-65558de32504,network=Network(8b4357ed-4d80-4cc0-968e-860a02e50672),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2a4787-3b')
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:8a:1b,bridge_name='br-int',has_traffic_filtering=True,id=62eac28e-c1d0-4be7-aa1b-550d0174481c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eac28e-c1') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:8a:1b,bridge_name='br-int',has_traffic_filtering=True,id=62eac28e-c1d0-4be7-aa1b-550d0174481c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eac28e-c1') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62eac28e-c1, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:34 user nova-compute[73012]: INFO os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:8a:1b,bridge_name='br-int',has_traffic_filtering=True,id=62eac28e-c1d0-4be7-aa1b-550d0174481c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eac28e-c1')
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T12:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1458564983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1458564983',id=19,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZnUCiplpGZRVUxexTjJK/d54gWohb1ZBNiiyuONUR3h2HgvsfepI3gprYS9rdKsz1lEQfBMMRGzalbrbIY6K8Mdxsls3ar+hUjsepX21afVM2Pd8swt4TwmQc/DK8VA==',key_name='tempest-keypair-727213629',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61e73551aaed4aa6be678848f889f8c7',ramdisk_id='',reservation_id='r-xcjef0ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1914023159',owner_user_name='tempest-TaggedBootDevicesTest-1914023159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee6d00a3d5342fa860cc3fcdf3b46aa',uuid=427440ec-266a-41ab-b7e8-8d4f193d3671,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converting VIF {"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:ac,bridge_name='br-int',has_traffic_filtering=True,id=b0ef7268-1dcf-47b3-893c-1401063d1c5c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ef7268-1d') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:ac,bridge_name='br-int',has_traffic_filtering=True,id=b0ef7268-1dcf-47b3-893c-1401063d1c5c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ef7268-1d') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0ef7268-1d, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:34 user nova-compute[73012]: INFO os_vif [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ee:ac,bridge_name='br-int',has_traffic_filtering=True,id=b0ef7268-1dcf-47b3-893c-1401063d1c5c,network=Network(42ccd93a-11a9-4953-8926-1ec12c0aefd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ef7268-1d')
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuysKqGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cb00d4-7398-44fa-bd20-0000bbb1dd9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9def67eb-f64a-48a5-8277-0577a791c687]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:13:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:13:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9af016fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0212da3-7bbd-459b-afa0-8230360475ad]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1401f739-0c02-4077-a940-861294f0988e]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e00ce6a-b339-4f11-b6ed-446715a55bbf]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[01241f90-93bf-4c3d-b3af-b480b7b40097]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[123c8343-7b34-435b-98a3-b56d1436ba9e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfcb3f5-54a4-4eff-98f3-c61fbd0b5319]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd, portal: 172.16.0.220,3260]
Aug 14 12:13:34 user nova-compute[73012]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd, portal: 172.16.0.220,3260] successful.
Aug 14 12:13:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fffc7f7b-4e7a-4abd-bcb1-37d1d858c7dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b6ecf-8e12-4896-8037-4f26624caab8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] <== disconnect_volume: return (327ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuGzyjAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47343aa-0753-4232-9f19-dc75ac5f016a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72224ee-cd8a-4e78-8960-39c4430a0015]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:13:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:13:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0169a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a'): ({'sdf'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Removing single pathed devices sdf {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING nova.compute.manager [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-0e772e4c-640f-4440-83db-edd3ce27c7f8 for instance with vm_state active and task_state deleting.
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-unplugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING nova.compute.manager [req-50647f71-3cee-4336-aec9-1f7a4c59eea5 req-1d1d9274-72cd-4917-a9cb-312be30c55f4 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-b0ef7268-1dcf-47b3-893c-1401063d1c5c for instance with vm_state active and task_state deleting.
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[529295cc-599d-426d-8c78-15ef4d8960df]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[763db2c2-6379-4b11-955e-42b21fc46908]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-8f766834-3616-4cde-a637-1e69ea30b119 for instance with vm_state active and task_state deleting.
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-unplugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-3e2365da-a29b-45bf-bea0-5f20cb9a07e5 for instance with vm_state active and task_state deleting.
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-unplugged-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-01f3ceea-f399-418f-a617-d60a5734079a for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-01f3ceea-f399-418f-a617-d60a5734079a for instance with vm_state active and task_state deleting.
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-unplugged-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-ce2a4787-3b7d-490d-a9c2-65558de32504 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-ce2a4787-3b7d-490d-a9c2-65558de32504 for instance with vm_state active and task_state deleting.
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-unplugged-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-unplugged-62eac28e-c1d0-4be7-aa1b-550d0174481c for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-plugged-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Acquiring lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] No waiting events found dispatching network-vif-plugged-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING nova.compute.manager [req-8c8a279b-d5df-4380-a6ad-e35baec81a16 req-7f279c11-1cdd-4120-87ed-e5121c725826 service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received unexpected event network-vif-plugged-62eac28e-c1d0-4be7-aa1b-550d0174481c for instance with vm_state active and task_state deleting.
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Flushing IO for device /dev/sdf {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a1fe4e-1acc-42b5-a155-d10a1a93ea67]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c6b06b-0a19-4454-9fe5-f4c729a077e2]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] SCSI volumes sdf have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eae1ef-c49d-4640-8dc9-40c57c90ccf0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f55de-96a0-4656-b5da-0d0b2191e562]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a, portal: 172.16.0.220,3260]
Aug 14 12:13:34 user nova-compute[73012]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a, portal: 172.16.0.220,3260] successful.
Aug 14 12:13:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b338f7b3-8be1-454e-8f22-65baef92e40a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d1034-c28f-445f-90ca-f76bb915cbe5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] <== disconnect_volume: return (352ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnayqOZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:13:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91f5ba3-e193-45f5-b5a3-5f7ef72800b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabdcc1f-e009-4ad5-859f-43d54db66447]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:13:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 (non-flash)
Aug 14 12:13:34 user nova-compute[73012]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:13:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0169a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271'): ({'sdg'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Removing single pathed devices sdg {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[82808b72-7199-45f7-876b-e71ebc3c5dc7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cbc795-261f-4a96-ad8d-121a945c5a81]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Flushing IO for device /dev/sdg {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:13:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8426789c-0ea2-4446-bf4d-ad876e65442f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cee5fe5-3276-428b-9e77-f825ce740902]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] SCSI volumes sdg have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b587d5-9449-4d9c-b93c-d4fa8c533cc0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75113ac-f92d-4529-99d0-f7dbdf9afa35]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271, portal: 172.16.0.220,3260]
Aug 14 12:13:35 user nova-compute[73012]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271, portal: 172.16.0.220,3260] successful.
Aug 14 12:13:35 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a72a74ef-560d-4e30-a9ce-8d809b5ed271 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2fce16-561f-4cbe-9a50-e91782376a56]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] <== disconnect_volume: return (336ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:13:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Deleting instance files /opt/stack/data/nova/instances/427440ec-266a-41ab-b7e8-8d4f193d3671_del
Aug 14 12:13:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Deletion of /opt/stack/data/nova/instances/427440ec-266a-41ab-b7e8-8d4f193d3671_del complete
Aug 14 12:13:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:35 user nova-compute[73012]: INFO nova.compute.manager [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Took 3.22 seconds to destroy the instance on the hypervisor.
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c522171-959d-4912-bd15-2588da6692ad req-a5b0cbe6-6202-4ab0-bab4-240fdec33d6c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-deleted-8f766834-3616-4cde-a637-1e69ea30b119 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:37 user nova-compute[73012]: INFO nova.compute.manager [req-7c522171-959d-4912-bd15-2588da6692ad req-a5b0cbe6-6202-4ab0-bab4-240fdec33d6c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Neutron deleted interface 8f766834-3616-4cde-a637-1e69ea30b119; detaching it from the instance and deleting it from the info cache
Aug 14 12:13:37 user nova-compute[73012]: DEBUG nova.network.neutron [req-7c522171-959d-4912-bd15-2588da6692ad req-a5b0cbe6-6202-4ab0-bab4-240fdec33d6c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [{"id": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "address": "fa:16:3e:0e:1f:5d", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e772e4c-64", "ovs_interfaceid": "0e772e4c-640f-4440-83db-edd3ce27c7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "address": "fa:16:3e:7e:a4:0f", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2365da-a2", "ovs_interfaceid": "3e2365da-a29b-45bf-bea0-5f20cb9a07e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01f3ceea-f399-418f-a617-d60a5734079a", "address": "fa:16:3e:d8:17:a3", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f3ceea-f3", "ovs_interfaceid": "01f3ceea-f399-418f-a617-d60a5734079a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce2a4787-3b7d-490d-a9c2-65558de32504", "address": "fa:16:3e:5c:25:90", "network": {"id": "8b4357ed-4d80-4cc0-968e-860a02e50672", "bridge": "br-int", "label": "tempest-device-tagging-net1-1936449384", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2a4787-3b", "ovs_interfaceid": "ce2a4787-3b7d-490d-a9c2-65558de32504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "address": "fa:16:3e:5b:8a:1b", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eac28e-c1", "ovs_interfaceid": "62eac28e-c1d0-4be7-aa1b-550d0174481c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "address": "fa:16:3e:a0:ee:ac", "network": {"id": "42ccd93a-11a9-4953-8926-1ec12c0aefd0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1573794647", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61e73551aaed4aa6be678848f889f8c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ef7268-1d", "ovs_interfaceid": "b0ef7268-1dcf-47b3-893c-1401063d1c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c522171-959d-4912-bd15-2588da6692ad req-a5b0cbe6-6202-4ab0-bab4-240fdec33d6c service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Detach interface failed, port_id=8f766834-3616-4cde-a637-1e69ea30b119, reason: Instance 427440ec-266a-41ab-b7e8-8d4f193d3671 could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:13:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:13:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:13:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7276MB free_disk=25.620689392089844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 427440ec-266a-41ab-b7e8-8d4f193d3671 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 1810186d-ef32-46ff-ba1c-509e9afe1318 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance dadd3d4a-74da-416f-935c-2b064ea2ec16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance cfa2f996-7907-4490-84d6-c04c5d0ca6e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:38 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:13:38 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Took 3.69 seconds to deallocate network for instance.
Aug 14 12:13:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-87c7c384-c9e7-4add-902b-08b1141ed3b3 req-167f0937-b452-4a52-90a8-91f89a55e2da service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-deleted-b0ef7268-1dcf-47b3-893c-1401063d1c5c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-87c7c384-c9e7-4add-902b-08b1141ed3b3 req-167f0937-b452-4a52-90a8-91f89a55e2da service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-deleted-01f3ceea-f399-418f-a617-d60a5734079a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-87c7c384-c9e7-4add-902b-08b1141ed3b3 req-167f0937-b452-4a52-90a8-91f89a55e2da service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-deleted-ce2a4787-3b7d-490d-a9c2-65558de32504 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-87c7c384-c9e7-4add-902b-08b1141ed3b3 req-167f0937-b452-4a52-90a8-91f89a55e2da service nova] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Received event network-vif-deleted-62eac28e-c1d0-4be7-aa1b-550d0174481c {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:13:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:41 user nova-compute[73012]: INFO nova.compute.manager [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Took 2.33 seconds to detach 3 volumes for instance.
Aug 14 12:13:41 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:13:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:13:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:13:41 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:13:41 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:13:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:41 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Deleted allocations for instance 427440ec-266a-41ab-b7e8-8d4f193d3671
Aug 14 12:13:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2e4e27ce-2930-41a3-a6bd-91605fb2fb23 tempest-TaggedBootDevicesTest-1914023159 tempest-TaggedBootDevicesTest-1914023159-project-member] Lock "427440ec-266a-41ab-b7e8-8d4f193d3671" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.869s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:13:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:48 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015213.7596447, 427440ec-266a-41ab-b7e8-8d4f193d3671 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:13:48 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] VM Stopped (Lifecycle Event)
Aug 14 12:13:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ed101b45-521b-499b-98cc-8003d79e03d4 None None] [instance: 427440ec-266a-41ab-b7e8-8d4f193d3671] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:13:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:13:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:13:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:13:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:13:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:13:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:05 user nova-compute[73012]: INFO nova.compute.manager [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Rescuing
Aug 14 12:14:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:14:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquired lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:14:05 user nova-compute[73012]: DEBUG nova.network.neutron [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG nova.network.neutron [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updating instance_info_cache with network_info: [{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Releasing lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-6c5df572-8110-474e-a083-1017a7ab8db0 req-f73bd2a8-5c01-40c4-9475-fa7185bf6f4c service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-unplugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6c5df572-8110-474e-a083-1017a7ab8db0 req-f73bd2a8-5c01-40c4-9475-fa7185bf6f4c service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6c5df572-8110-474e-a083-1017a7ab8db0 req-f73bd2a8-5c01-40c4-9475-fa7185bf6f4c service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6c5df572-8110-474e-a083-1017a7ab8db0 req-f73bd2a8-5c01-40c4-9475-fa7185bf6f4c service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-6c5df572-8110-474e-a083-1017a7ab8db0 req-f73bd2a8-5c01-40c4-9475-fa7185bf6f4c service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-unplugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:06 user nova-compute[73012]: WARNING nova.compute.manager [req-6c5df572-8110-474e-a083-1017a7ab8db0 req-f73bd2a8-5c01-40c4-9475-fa7185bf6f4c service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-unplugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state active and task_state rescuing.
Aug 14 12:14:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Instance destroyed successfully.
Aug 14 12:14:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Attempting rescue
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73012) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Instance directory exists: not creating {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 12:14:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Creating image(s)
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'trusted_certs' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "1810186d-ef32-46ff-ba1c-509e9afe1318" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:07 user nova-compute[73012]: INFO nova.compute.manager [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Terminating instance
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue" returned: 0 in 0.057s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'migration_context' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Start _get_guest_xml network_info=[{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "vif_mac": "fa:16:3e:9e:12:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'resources' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'numa_topology' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:14:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'vcpu_model' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-852374389',display_name='tempest-ServerRescueNegativeTestJSON-server-852374389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-852374389',id=14,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-raidpx0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:09:28Z,user_data=None,user_id='e7128922092841c49b475af30075e458',uuid=c2247c01-f5c8-42f3-9f16-231e7198d4e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "vif_mac": "fa:16:3e:9e:12:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "vif_mac": "fa:16:3e:9e:12:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:12:3c,bridge_name='br-int',has_traffic_filtering=True,id=8935f630-5b68-43e3-a48c-ae0f19b19368,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8935f630-5b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'pci_devices' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:14:07 user nova-compute[73012]:   <uuid>c2247c01-f5c8-42f3-9f16-231e7198d4e8</uuid>
Aug 14 12:14:07 user nova-compute[73012]:   <name>instance-0000000e</name>
Aug 14 12:14:07 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:14:07 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:14:07 user nova-compute[73012]:   <metadata>
Aug 14 12:14:07 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:14:07 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:14:07 user nova-compute[73012]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-852374389</nova:name>
Aug 14 12:14:07 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:14:07</nova:creationTime>
Aug 14 12:14:07 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:14:07 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:14:07 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:14:07 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:14:07 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:14:07 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:14:07 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:14:07 user nova-compute[73012]:       <nova:owner>
Aug 14 12:14:07 user nova-compute[73012]:         <nova:user uuid="e7128922092841c49b475af30075e458">tempest-ServerRescueNegativeTestJSON-334705254-project-member</nova:user>
Aug 14 12:14:07 user nova-compute[73012]:         <nova:project uuid="96ac2852176e4d7580080e2320371fe8">tempest-ServerRescueNegativeTestJSON-334705254</nova:project>
Aug 14 12:14:07 user nova-compute[73012]:       </nova:owner>
Aug 14 12:14:07 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:14:07 user nova-compute[73012]:       <nova:ports>
Aug 14 12:14:07 user nova-compute[73012]:         <nova:port uuid="8935f630-5b68-43e3-a48c-ae0f19b19368">
Aug 14 12:14:07 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 12:14:07 user nova-compute[73012]:         </nova:port>
Aug 14 12:14:07 user nova-compute[73012]:       </nova:ports>
Aug 14 12:14:07 user nova-compute[73012]:     </nova:instance>
Aug 14 12:14:07 user nova-compute[73012]:   </metadata>
Aug 14 12:14:07 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:14:07 user nova-compute[73012]:     <system>
Aug 14 12:14:07 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:14:07 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:14:07 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:14:07 user nova-compute[73012]:       <entry name="serial">c2247c01-f5c8-42f3-9f16-231e7198d4e8</entry>
Aug 14 12:14:07 user nova-compute[73012]:       <entry name="uuid">c2247c01-f5c8-42f3-9f16-231e7198d4e8</entry>
Aug 14 12:14:07 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:14:07 user nova-compute[73012]:     </system>
Aug 14 12:14:07 user nova-compute[73012]:   </sysinfo>
Aug 14 12:14:07 user nova-compute[73012]:   <os>
Aug 14 12:14:07 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:14:07 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:14:07 user nova-compute[73012]:   </os>
Aug 14 12:14:07 user nova-compute[73012]:   <features>
Aug 14 12:14:07 user nova-compute[73012]:     <acpi/>
Aug 14 12:14:07 user nova-compute[73012]:     <apic/>
Aug 14 12:14:07 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:14:07 user nova-compute[73012]:   </features>
Aug 14 12:14:07 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:14:07 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:14:07 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:14:07 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:14:07 user nova-compute[73012]:   </clock>
Aug 14 12:14:07 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:14:07 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:14:07 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:14:07 user nova-compute[73012]:   </cpu>
Aug 14 12:14:07 user nova-compute[73012]:   <devices>
Aug 14 12:14:07 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:14:07 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:14:07 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue"/>
Aug 14 12:14:07 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:14:07 user nova-compute[73012]:     </disk>
Aug 14 12:14:07 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:14:07 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:14:07 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk"/>
Aug 14 12:14:07 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:14:07 user nova-compute[73012]:     </disk>
Aug 14 12:14:07 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:14:07 user nova-compute[73012]:       <mac address="fa:16:3e:9e:12:3c"/>
Aug 14 12:14:07 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:14:07 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:14:07 user nova-compute[73012]:       <target dev="tap8935f630-5b"/>
Aug 14 12:14:07 user nova-compute[73012]:     </interface>
Aug 14 12:14:07 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:14:07 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/console.log" append="off"/>
Aug 14 12:14:07 user nova-compute[73012]:     </serial>
Aug 14 12:14:07 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:14:07 user nova-compute[73012]:     <video>
Aug 14 12:14:07 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:14:07 user nova-compute[73012]:     </video>
Aug 14 12:14:07 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:14:07 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:14:07 user nova-compute[73012]:     </rng>
Aug 14 12:14:07 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:14:07 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:14:07 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:14:07 user nova-compute[73012]:     </memballoon>
Aug 14 12:14:07 user nova-compute[73012]:   </devices>
Aug 14 12:14:07 user nova-compute[73012]: </domain>
Aug 14 12:14:07 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:14:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Instance destroyed successfully.
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-22ab724a-bb20-4fe0-b094-f1a06047fa3b req-3bc4f095-b353-459f-9703-1974c8c693f7 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received event network-vif-unplugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22ab724a-bb20-4fe0-b094-f1a06047fa3b req-3bc4f095-b353-459f-9703-1974c8c693f7 service nova] Acquiring lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22ab724a-bb20-4fe0-b094-f1a06047fa3b req-3bc4f095-b353-459f-9703-1974c8c693f7 service nova] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22ab724a-bb20-4fe0-b094-f1a06047fa3b req-3bc4f095-b353-459f-9703-1974c8c693f7 service nova] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-22ab724a-bb20-4fe0-b094-f1a06047fa3b req-3bc4f095-b353-459f-9703-1974c8c693f7 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] No waiting events found dispatching network-vif-unplugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-22ab724a-bb20-4fe0-b094-f1a06047fa3b req-3bc4f095-b353-459f-9703-1974c8c693f7 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received event network-vif-unplugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No VIF found with MAC fa:16:3e:9e:12:3c, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:14:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Instance destroyed successfully.
Aug 14 12:14:08 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lazy-loading 'resources' on Instance uuid 1810186d-ef32-46ff-ba1c-509e9afe1318 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1160351257',display_name='tempest-ServersNegativeTestJSON-server-1160351257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1160351257',id=20,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eae6df64fbac46eeb8de845a5b22b406',ramdisk_id='',reservation_id='r-y8lfxt3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-78801721',owner_user_name='tempest-ServersNegativeTestJSON-78801721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:25Z,user_data=None,user_id='10e35f53a2144a57ab7c200323cccbe5',uuid=1810186d-ef32-46ff-ba1c-509e9afe1318,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converting VIF {"id": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "address": "fa:16:3e:b1:38:3c", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf9b8f5-04", "ovs_interfaceid": "ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf9b8f5-04') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG os_vif [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf9b8f5-04') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddf9b8f5-04, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:08 user nova-compute[73012]: INFO os_vif [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:38:3c,bridge_name='br-int',has_traffic_filtering=True,id=ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf9b8f5-04')
Aug 14 12:14:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Deleting instance files /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318_del
Aug 14 12:14:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Deletion of /opt/stack/data/nova/instances/1810186d-ef32-46ff-ba1c-509e9afe1318_del complete
Aug 14 12:14:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-0f91aafe-cfaa-4916-9359-c8f12491c45d req-f8be2447-fd2e-44c2-a23a-4138db055217 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0f91aafe-cfaa-4916-9359-c8f12491c45d req-f8be2447-fd2e-44c2-a23a-4138db055217 service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0f91aafe-cfaa-4916-9359-c8f12491c45d req-f8be2447-fd2e-44c2-a23a-4138db055217 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0f91aafe-cfaa-4916-9359-c8f12491c45d req-f8be2447-fd2e-44c2-a23a-4138db055217 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-0f91aafe-cfaa-4916-9359-c8f12491c45d req-f8be2447-fd2e-44c2-a23a-4138db055217 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:08 user nova-compute[73012]: WARNING nova.compute.manager [req-0f91aafe-cfaa-4916-9359-c8f12491c45d req-f8be2447-fd2e-44c2-a23a-4138db055217 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state active and task_state rescuing.
Aug 14 12:14:08 user nova-compute[73012]: INFO nova.compute.manager [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Took 1.43 seconds to destroy the instance on the hypervisor.
Aug 14 12:14:08 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:14:08 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:09 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Took 0.61 seconds to deallocate network for instance.
Aug 14 12:14:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-9e899d80-12e9-4447-90e3-37905c0ce5a2 req-afe62818-b74d-4b1d-8ffa-6fb5914b83cf service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received event network-vif-deleted-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-163e4220-b813-4958-9d03-3c87c2e8dd6e req-b49e9ca4-97f0-422d-880c-8acfc6b8efb7 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received event network-vif-plugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-163e4220-b813-4958-9d03-3c87c2e8dd6e req-b49e9ca4-97f0-422d-880c-8acfc6b8efb7 service nova] Acquiring lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-163e4220-b813-4958-9d03-3c87c2e8dd6e req-b49e9ca4-97f0-422d-880c-8acfc6b8efb7 service nova] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-163e4220-b813-4958-9d03-3c87c2e8dd6e req-b49e9ca4-97f0-422d-880c-8acfc6b8efb7 service nova] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-163e4220-b813-4958-9d03-3c87c2e8dd6e req-b49e9ca4-97f0-422d-880c-8acfc6b8efb7 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] No waiting events found dispatching network-vif-plugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:09 user nova-compute[73012]: WARNING nova.compute.manager [req-163e4220-b813-4958-9d03-3c87c2e8dd6e req-b49e9ca4-97f0-422d-880c-8acfc6b8efb7 service nova] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Received unexpected event network-vif-plugged-ddf9b8f5-0489-46b6-9c9f-ecda07a6ab27 for instance with vm_state deleted and task_state None.
Aug 14 12:14:09 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:14:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:09 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Deleted allocations for instance 1810186d-ef32-46ff-ba1c-509e9afe1318
Aug 14 12:14:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f6d4880a-18e4-4e83-80c8-ea3f08fa2090 tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "1810186d-ef32-46ff-ba1c-509e9afe1318" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.713s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:10 user nova-compute[73012]: WARNING nova.compute.manager [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state active and task_state rescuing.
Aug 14 12:14:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:10 user nova-compute[73012]: WARNING nova.compute.manager [req-22962b46-d449-489e-82ce-fcf3058b9fbf req-5b6f141f-8696-4ecf-83cb-c2aa2b83578b service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state active and task_state rescuing.
Aug 14 12:14:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for c2247c01-f5c8-42f3-9f16-231e7198d4e8 due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:14:11 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015251.3935761, c2247c01-f5c8-42f3-9f16-231e7198d4e8 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:14:11 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] VM Resumed (Lifecycle Event)
Aug 14 12:14:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6133d603-c59c-4ed3-bdde-bdcfda738d6f tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:14:11 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 12:14:11 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015251.3947005, c2247c01-f5c8-42f3-9f16-231e7198d4e8 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:14:11 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] VM Started (Lifecycle Event)
Aug 14 12:14:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:12 user nova-compute[73012]: INFO nova.compute.manager [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Terminating instance
Aug 14 12:14:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-changed-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing instance network info cache due to event network-changed-93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] Acquiring lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] Acquired lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:14:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Refreshing network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:13 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Instance destroyed successfully.
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.objects.instance [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lazy-loading 'resources' on Instance uuid dadd3d4a-74da-416f-935c-2b064ea2ec16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1274032774',display_name='tempest-TestShelveInstance-server-1274032774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1274032774',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpvfnDao+SuLCMwRtL6cICXvUR1y5xlI3EH4m/HCXMmrxCVfeVnw3wZr2m9KhBLwd9siNn+DZrbvEClHq9XQvO7VWCT5H/PVyxJXoTl8JDpT4hI1H7VfVFKutGQiWgNJw==',key_name='tempest-TestShelveInstance-584983205',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e44af87d2aa64185ad02ba16d7cfe6b4',ramdisk_id='',reservation_id='r-thm9qhfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-588328482',owner_user_name='tempest-TestShelveInstance-588328482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:12:47Z,user_data=None,user_id='ab939cda27a1447088d51c94b161f4d3',uuid=dadd3d4a-74da-416f-935c-2b064ea2ec16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converting VIF {"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_vif [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93451164-a2, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:14:13 user nova-compute[73012]: INFO os_vif [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b1:ad,bridge_name='br-int',has_traffic_filtering=True,id=93451164-a21f-49aa-991b-a941f82c80ee,network=Network(dce7cdf3-941d-4328-915d-bbad67902915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93451164-a2')
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WMgAODHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:14:13 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updated VIF entry in instance network info cache for port 93451164-a21f-49aa-991b-a941f82c80ee. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating instance_info_cache with network_info: [{"id": "93451164-a21f-49aa-991b-a941f82c80ee", "address": "fa:16:3e:84:b1:ad", "network": {"id": "dce7cdf3-941d-4328-915d-bbad67902915", "bridge": "br-int", "label": "tempest-TestShelveInstance-444385327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e44af87d2aa64185ad02ba16d7cfe6b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93451164-a2", "ovs_interfaceid": "93451164-a21f-49aa-991b-a941f82c80ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe9efe-d88c-403e-a4fe-009f4aa82481]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] Releasing lock "refresh_cache-dadd3d4a-74da-416f-935c-2b064ea2ec16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-unplugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] No waiting events found dispatching network-vif-unplugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-58174ec3-9bba-4524-a1ce-c8f1add66c05 req-32db261e-5906-4d2a-985f-9e5ecb7cca0b service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-unplugged-93451164-a21f-49aa-991b-a941f82c80ee for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e62d677-213a-4879-a903-eefe18a59912]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:14:13 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b (non-flash)
Aug 14 12:14:13 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad050f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b'): ({'sdi'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Removing single pathed devices sdi {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4e9cd2-0679-4b35-a9c3-a91e187ff290]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b828b8c-25c9-4ce2-9d7f-dc8af3082ce7]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Flushing IO for device /dev/sdi {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[646d007d-e2cd-419f-816d-39507e83e064]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb38a6bf-3f3b-45cf-b0e5-66978b2088ba]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] SCSI volumes sdi have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO66d93a89-4c36a6f13ad363dc', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_66d93a89', '/dev/disk/by-id/scsi-23463333661366631') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ae4f36-45e5-42ae-a691-5f7157e7aa44]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe6fe4d-587f-4ac2-9edd-1f0b64997207]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0ca53b-6c3e-412f-a00b-641d31601879]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260]
Aug 14 12:14:13 user nova-compute[73012]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b, portal: 172.16.0.220,3260] successful.
Aug 14 12:14:13 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae658aa7-5072-4837-a2ba-a4221136e98b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c005d28e-b5b4-432f-afa0-583a58f8c5ad]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] <== disconnect_volume: return (321ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:14:13 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Deleting instance files /opt/stack/data/nova/instances/dadd3d4a-74da-416f-935c-2b064ea2ec16_del
Aug 14 12:14:13 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Deletion of /opt/stack/data/nova/instances/dadd3d4a-74da-416f-935c-2b064ea2ec16_del complete
Aug 14 12:14:13 user nova-compute[73012]: INFO nova.compute.manager [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 14 12:14:13 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:14:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:14 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:14:14 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Took 0.76 seconds to deallocate network for instance.
Aug 14 12:14:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-4d282695-c78e-449c-a83e-3a197b3cbfbf req-a90d745d-ca1c-43d6-8e44-e59f9339fb9b service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-deleted-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-ef173a76-de04-47d8-844d-353e67008ba7 req-13b8f483-39a6-4d97-9516-c9d8726ce197 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ef173a76-de04-47d8-844d-353e67008ba7 req-13b8f483-39a6-4d97-9516-c9d8726ce197 service nova] Acquiring lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ef173a76-de04-47d8-844d-353e67008ba7 req-13b8f483-39a6-4d97-9516-c9d8726ce197 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ef173a76-de04-47d8-844d-353e67008ba7 req-13b8f483-39a6-4d97-9516-c9d8726ce197 service nova] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-ef173a76-de04-47d8-844d-353e67008ba7 req-13b8f483-39a6-4d97-9516-c9d8726ce197 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] No waiting events found dispatching network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:14 user nova-compute[73012]: WARNING nova.compute.manager [req-ef173a76-de04-47d8-844d-353e67008ba7 req-13b8f483-39a6-4d97-9516-c9d8726ce197 service nova] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Received unexpected event network-vif-plugged-93451164-a21f-49aa-991b-a941f82c80ee for instance with vm_state active and task_state deleting.
Aug 14 12:14:15 user nova-compute[73012]: INFO nova.compute.manager [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Took 0.78 seconds to detach 1 volumes for instance.
Aug 14 12:14:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Deleting volume: ae658aa7-5072-4837-a2ba-a4221136e98b {{(pid=73012) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 12:14:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:15 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:14:15 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:14:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:15 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Deleted allocations for instance dadd3d4a-74da-416f-935c-2b064ea2ec16
Aug 14 12:14:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05cd7dcc-dc04-4cf2-8a8d-a6ff38617df0 tempest-TestShelveInstance-588328482 tempest-TestShelveInstance-588328482-project-member] Lock "dadd3d4a-74da-416f-935c-2b064ea2ec16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.415s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:23 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015248.475761, 1810186d-ef32-46ff-ba1c-509e9afe1318 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:14:23 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] VM Stopped (Lifecycle Event)
Aug 14 12:14:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9cd25a0c-9bc0-4e5e-9667-814033c070a0 None None] [instance: 1810186d-ef32-46ff-ba1c-509e9afe1318] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:28 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015253.1678016, dadd3d4a-74da-416f-935c-2b064ea2ec16 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:14:28 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] VM Stopped (Lifecycle Event)
Aug 14 12:14:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-677c9fc1-08bc-4fc1-bb54-c882b1be4614 None None] [instance: dadd3d4a-74da-416f-935c-2b064ea2ec16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:14:29 user nova-compute[73012]: INFO nova.compute.claims [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Claim successful on node user
Aug 14 12:14:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:14:29 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:14:29 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:14:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:14:30 user nova-compute[73012]: INFO nova.virt.block_device [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Booting with volume 79f9156a-c066-4074-a84c-90e59b36fc38 at /dev/vda
Aug 14 12:14:30 user nova-compute[73012]: DEBUG nova.policy [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5f6ace32c7b422ebe6f0d6f5d179988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d8edb773fa44bc847d02cac0a00483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG os_brick.utils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e749d68d-5a69-4790-9d2f-548637c314d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51186a7-68e1-470d-a896-1855d0dec835]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.037s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b2aeea-4971-4b42-b79c-e423e0ce4181]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b044b64b-1dbb-4772-adc3-a6b8040d2503]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:14:30 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c5fb4b-acd5-496e-9761-b28ae9018c8b]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG os_brick.utils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Updating existing volume attachment record: 16382966-70bf-4ba9-936e-d94164e361d4 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-2f72af67-6a46-4fdc-9ba4-0a02bb0181e8 req-b619f00a-781b-49fc-8103-29120a26588a service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-changed-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-2f72af67-6a46-4fdc-9ba4-0a02bb0181e8 req-b619f00a-781b-49fc-8103-29120a26588a service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Refreshing instance network info cache due to event network-changed-a3cb9338-9b9e-48ed-9da8-1cef3094170d. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2f72af67-6a46-4fdc-9ba4-0a02bb0181e8 req-b619f00a-781b-49fc-8103-29120a26588a service nova] Acquiring lock "refresh_cache-0d1c12d3-8962-49e8-8ad5-071caee70b94" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2f72af67-6a46-4fdc-9ba4-0a02bb0181e8 req-b619f00a-781b-49fc-8103-29120a26588a service nova] Acquired lock "refresh_cache-0d1c12d3-8962-49e8-8ad5-071caee70b94" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:14:30 user nova-compute[73012]: DEBUG nova.network.neutron [req-2f72af67-6a46-4fdc-9ba4-0a02bb0181e8 req-b619f00a-781b-49fc-8103-29120a26588a service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Refreshing network info cache for port a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG nova.objects.instance [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'flavor' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:31 user nova-compute[73012]: INFO nova.compute.manager [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Attaching volume 1d15a83c-3596-476f-a2c3-a3857a560a5e to /dev/vdb
Aug 14 12:14:31 user nova-compute[73012]: DEBUG os_brick.utils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfdfebd-87eb-45d2-84fb-dcc45aefdb21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4f7aab-4b3e-4b39-8df0-d21f7a6738a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[616c3e3e-83a5-41e6-b608-7d96bd31561e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e99ef66-fb49-4646-910a-a9d39a739fb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:14:31 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b37c14-ac00-4345-bd89-eefedd2a8247]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG os_brick.utils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Updating existing volume attachment record: 1c8a694b-2319-4acd-8e15-3f3cfc60b1bd {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Successfully created port: c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG nova.network.neutron [req-2f72af67-6a46-4fdc-9ba4-0a02bb0181e8 req-b619f00a-781b-49fc-8103-29120a26588a service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Updated VIF entry in instance network info cache for port a3cb9338-9b9e-48ed-9da8-1cef3094170d. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG nova.network.neutron [req-2f72af67-6a46-4fdc-9ba4-0a02bb0181e8 req-b619f00a-781b-49fc-8103-29120a26588a service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Updating instance_info_cache with network_info: [{"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:14:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2f72af67-6a46-4fdc-9ba4-0a02bb0181e8 req-b619f00a-781b-49fc-8103-29120a26588a service nova] Releasing lock "refresh_cache-0d1c12d3-8962-49e8-8ad5-071caee70b94" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Successfully updated port: c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "refresh_cache-634acb0d-490b-4b60-b4f3-947ee8e17457" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquired lock "refresh_cache-634acb0d-490b-4b60-b4f3-947ee8e17457" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-7cecadad-3f46-445b-b88d-ba8cfdaee467 req-d38810f6-b85a-409f-87fa-c2d0fd255a48 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-changed-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-7cecadad-3f46-445b-b88d-ba8cfdaee467 req-d38810f6-b85a-409f-87fa-c2d0fd255a48 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Refreshing instance network info cache due to event network-changed-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7cecadad-3f46-445b-b88d-ba8cfdaee467 req-d38810f6-b85a-409f-87fa-c2d0fd255a48 service nova] Acquiring lock "refresh_cache-634acb0d-490b-4b60-b4f3-947ee8e17457" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:14:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Updating instance_info_cache with network_info: [{"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Releasing lock "refresh_cache-634acb0d-490b-4b60-b4f3-947ee8e17457" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance network_info: |[{"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7cecadad-3f46-445b-b88d-ba8cfdaee467 req-d38810f6-b85a-409f-87fa-c2d0fd255a48 service nova] Acquired lock "refresh_cache-634acb0d-490b-4b60-b4f3-947ee8e17457" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG nova.network.neutron [req-7cecadad-3f46-445b-b88d-ba8cfdaee467 req-d38810f6-b85a-409f-87fa-c2d0fd255a48 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Refreshing network info cache for port c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG nova.network.neutron [req-7cecadad-3f46-445b-b88d-ba8cfdaee467 req-d38810f6-b85a-409f-87fa-c2d0fd255a48 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Updated VIF entry in instance network info cache for port c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG nova.network.neutron [req-7cecadad-3f46-445b-b88d-ba8cfdaee467 req-d38810f6-b85a-409f-87fa-c2d0fd255a48 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Updating instance_info_cache with network_info: [{"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7cecadad-3f46-445b-b88d-ba8cfdaee467 req-d38810f6-b85a-409f-87fa-c2d0fd255a48 service nova] Releasing lock "refresh_cache-634acb0d-490b-4b60-b4f3-947ee8e17457" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:36 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:14:36 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:14:36 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7675MB free_disk=25.633419036865234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:14:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance cfa2f996-7907-4490-84d6-c04c5d0ca6e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 634acb0d-490b-4b60-b4f3-947ee8e17457 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:14:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:14:38 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:14:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:14:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:14:38 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Updating instance_info_cache with network_info: [{"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:14:39 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Creating image(s)
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Ensure instance console log exists: /opt/stack/data/nova/instances/634acb0d-490b-4b60-b4f3-947ee8e17457/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Start _get_guest_xml network_info=[{"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSAcFGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '634acb0d-490b-4b60-b4f3-947ee8e17457', 'attached_at': '', 'detached_at': '', 'volume_id': '79f9156a-c066-4074-a84c-90e59b36fc38', 'serial': '79f9156a-c066-4074-a84c-90e59b36fc38'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '16382966-70bf-4ba9-936e-d94164e361d4', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:14:39 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:14:39 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSAcFGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:14:39 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:14:39 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:14:39 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a902ec85-8014-44aa-ae0b-e81308845b34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:14:39 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5c8bfa-89e6-4a5c-8564-cc1bc94c2b06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38] added
Aug 14 12:14:39 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0698ac9c-2415-4670-993d-c4e8a14f3b19]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a21bb0-e513-4a44-aea4-a4428e5e46b8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHSAcFGz {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHSAcFGz" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[236dd4cd-d80b-47b6-8679-15792be29f86]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NHSAcFGz'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e74604-81c1-4170-9a68-15f7e3687b3d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf92eaf8-9b82-4cd5-850d-753de5cc86cf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:14:39 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:14:39 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:14:39 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:14:39 user nova-compute[73012]: 
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ec5e2f-2e5e-4dcb-a8da-ef11c29ff062]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260]
Aug 14 12:14:39 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260] successful.
Aug 14 12:14:39 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ce68f-7cd1-47a1-8dd0-ca739b063e1e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3a7462-1f90-4885-a155-552a5d14a724]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:39 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:39 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[331e735e-3585-4433-865a-b7e610509d96]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:14:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSAcFGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQraqtTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:14:40 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26433643438353536', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433643438353536', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.331s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:14:40 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:14:40 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bd6231-cd0d-4425-9e8a-ee02f606bc86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:14:40 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-967795420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-967795420',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiv02NM7ly/GsobICpDT6xbGxQ/k8nXI2xD8KWTJ9NU7/1N/75H+g01HY/tgKIHkAjxMPMd5Bq1WB9THdIdhcSq+a2ng7zU/CwAUcMVT8u8+mSuR2gDPxvR8Awu4NKL/Q==',key_name='tempest-keypair-989125677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26d8edb773fa44bc847d02cac0a00483',ramdisk_id='',reservation_id='r-wetm1wbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-169217537',owner_user_name='tempest-ServerActionsV293TestJSON-169217537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f6ace32c7b422ebe6f0d6f5d179988',uuid=634acb0d-490b-4b60-b4f3-947ee8e17457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converting VIF {"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lazy-loading 'pci_devices' on Instance uuid 634acb0d-490b-4b60-b4f3-947ee8e17457 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:14:40 user nova-compute[73012]:   <uuid>634acb0d-490b-4b60-b4f3-947ee8e17457</uuid>
Aug 14 12:14:40 user nova-compute[73012]:   <name>instance-00000018</name>
Aug 14 12:14:40 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:14:40 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:14:40 user nova-compute[73012]:   <metadata>
Aug 14 12:14:40 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:14:40 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:14:40 user nova-compute[73012]:       <nova:name>tempest-ServerActionsV293TestJSON-server-967795420</nova:name>
Aug 14 12:14:40 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:14:39</nova:creationTime>
Aug 14 12:14:40 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:14:40 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:14:40 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:14:40 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:14:40 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:14:40 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:14:40 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:14:40 user nova-compute[73012]:       <nova:owner>
Aug 14 12:14:40 user nova-compute[73012]:         <nova:user uuid="d5f6ace32c7b422ebe6f0d6f5d179988">tempest-ServerActionsV293TestJSON-169217537-project-member</nova:user>
Aug 14 12:14:40 user nova-compute[73012]:         <nova:project uuid="26d8edb773fa44bc847d02cac0a00483">tempest-ServerActionsV293TestJSON-169217537</nova:project>
Aug 14 12:14:40 user nova-compute[73012]:       </nova:owner>
Aug 14 12:14:40 user nova-compute[73012]:       <nova:ports>
Aug 14 12:14:40 user nova-compute[73012]:         <nova:port uuid="c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860">
Aug 14 12:14:40 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 12:14:40 user nova-compute[73012]:         </nova:port>
Aug 14 12:14:40 user nova-compute[73012]:       </nova:ports>
Aug 14 12:14:40 user nova-compute[73012]:     </nova:instance>
Aug 14 12:14:40 user nova-compute[73012]:   </metadata>
Aug 14 12:14:40 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:14:40 user nova-compute[73012]:     <system>
Aug 14 12:14:40 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:14:40 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:14:40 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:14:40 user nova-compute[73012]:       <entry name="serial">634acb0d-490b-4b60-b4f3-947ee8e17457</entry>
Aug 14 12:14:40 user nova-compute[73012]:       <entry name="uuid">634acb0d-490b-4b60-b4f3-947ee8e17457</entry>
Aug 14 12:14:40 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:14:40 user nova-compute[73012]:     </system>
Aug 14 12:14:40 user nova-compute[73012]:   </sysinfo>
Aug 14 12:14:40 user nova-compute[73012]:   <os>
Aug 14 12:14:40 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:14:40 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:14:40 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:14:40 user nova-compute[73012]:   </os>
Aug 14 12:14:40 user nova-compute[73012]:   <features>
Aug 14 12:14:40 user nova-compute[73012]:     <acpi/>
Aug 14 12:14:40 user nova-compute[73012]:     <apic/>
Aug 14 12:14:40 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:14:40 user nova-compute[73012]:   </features>
Aug 14 12:14:40 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:14:40 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:14:40 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:14:40 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:14:40 user nova-compute[73012]:   </clock>
Aug 14 12:14:40 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:14:40 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:14:40 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:14:40 user nova-compute[73012]:   </cpu>
Aug 14 12:14:40 user nova-compute[73012]:   <devices>
Aug 14 12:14:40 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:14:40 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:14:40 user nova-compute[73012]:       <source dev="/dev/sdb"/>
Aug 14 12:14:40 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:14:40 user nova-compute[73012]:       <serial>79f9156a-c066-4074-a84c-90e59b36fc38</serial>
Aug 14 12:14:40 user nova-compute[73012]:     </disk>
Aug 14 12:14:40 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:14:40 user nova-compute[73012]:       <mac address="fa:16:3e:ec:ab:72"/>
Aug 14 12:14:40 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:14:40 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:14:40 user nova-compute[73012]:       <target dev="tapc0ece2ed-0a"/>
Aug 14 12:14:40 user nova-compute[73012]:     </interface>
Aug 14 12:14:40 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:14:40 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/634acb0d-490b-4b60-b4f3-947ee8e17457/console.log" append="off"/>
Aug 14 12:14:40 user nova-compute[73012]:     </serial>
Aug 14 12:14:40 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:14:40 user nova-compute[73012]:     <video>
Aug 14 12:14:40 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:14:40 user nova-compute[73012]:     </video>
Aug 14 12:14:40 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:14:40 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:14:40 user nova-compute[73012]:     </rng>
Aug 14 12:14:40 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:14:40 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:14:40 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:14:40 user nova-compute[73012]:     </memballoon>
Aug 14 12:14:40 user nova-compute[73012]:   </devices>
Aug 14 12:14:40 user nova-compute[73012]: </domain>
Aug 14 12:14:40 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-967795420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-967795420',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiv02NM7ly/GsobICpDT6xbGxQ/k8nXI2xD8KWTJ9NU7/1N/75H+g01HY/tgKIHkAjxMPMd5Bq1WB9THdIdhcSq+a2ng7zU/CwAUcMVT8u8+mSuR2gDPxvR8Awu4NKL/Q==',key_name='tempest-keypair-989125677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26d8edb773fa44bc847d02cac0a00483',ramdisk_id='',reservation_id='r-wetm1wbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-169217537',owner_user_name='tempest-ServerActionsV293TestJSON-169217537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f6ace32c7b422ebe6f0d6f5d179988',uuid=634acb0d-490b-4b60-b4f3-947ee8e17457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converting VIF {"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_vif [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e699c3b0-276b-4a6e-8270-324a3a00ac0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e] added
Aug 14 12:14:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0ece2ed-0a, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0ece2ed-0a, col_values=(('external_ids', {'iface-id': 'c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:ab:72', 'vm-uuid': '634acb0d-490b-4b60-b4f3-947ee8e17457'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:40 user nova-compute[73012]: INFO os_vif [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a')
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca80c7a-542c-4fc1-81da-ab39b2e22752]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[95faa658-65cb-42c1-817e-61acd27dbfa5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQraqtTd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQraqtTd" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7e178b-078b-4d6d-8a66-8e76099fec06]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQraqtTd'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] No VIF found with MAC fa:16:3e:ec:ab:72, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa26bb-ce58-4e60-960b-a2a752d4887b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d9d98f-45e0-47b9-9f16-baeced345d6c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:41 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:41 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[247068dd-9f36-477d-bdb8-5fde2829fd9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260]
Aug 14 12:14:41 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260] successful.
Aug 14 12:14:41 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[109070fb-51c2-4968-8700-0772cbee48e0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d2ec8-4c7f-4bf1-8ad2-9cba5d04f627]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:41 user nova-compute[73012]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:14:41 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:41 user nova-compute[73012]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:14:41 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e06886-f283-409e-8a28-9ea6faada621]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:14:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQraqtTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== connect_volume: return (1654ms) {'type': 'block', 'scsi_wwn': '23238396237666236', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238396237666236', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG nova.objects.instance [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'flavor' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:14:42 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:14:42 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:14:42 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:14:42 user nova-compute[73012]:   <serial>1d15a83c-3596-476f-a2c3-a3857a560a5e</serial>
Aug 14 12:14:42 user nova-compute[73012]: </disk>
Aug 14 12:14:42 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-9acf9893-8f4b-4c26-9e2d-34ffb99e0f0a req-384ec6ac-c266-4dec-85d4-49f8f0eb46e3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9acf9893-8f4b-4c26-9e2d-34ffb99e0f0a req-384ec6ac-c266-4dec-85d4-49f8f0eb46e3 service nova] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9acf9893-8f4b-4c26-9e2d-34ffb99e0f0a req-384ec6ac-c266-4dec-85d4-49f8f0eb46e3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9acf9893-8f4b-4c26-9e2d-34ffb99e0f0a req-384ec6ac-c266-4dec-85d4-49f8f0eb46e3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-9acf9893-8f4b-4c26-9e2d-34ffb99e0f0a req-384ec6ac-c266-4dec-85d4-49f8f0eb46e3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] No waiting events found dispatching network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:42 user nova-compute[73012]: WARNING nova.compute.manager [req-9acf9893-8f4b-4c26-9e2d-34ffb99e0f0a req-384ec6ac-c266-4dec-85d4-49f8f0eb46e3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received unexpected event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 for instance with vm_state building and task_state spawning.
Aug 14 12:14:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No VIF found with MAC fa:16:3e:07:9f:e3, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:14:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-14368f03-d8d0-4e30-b241-fa39ff6b1fe2 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.598s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:43 user nova-compute[73012]: INFO nova.compute.manager [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Rebuilding instance
Aug 14 12:14:43 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'pci_requests' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'resources' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'migration_context' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73012) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] No waiting events found dispatching network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:44 user nova-compute[73012]: WARNING nova.compute.manager [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received unexpected event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 for instance with vm_state building and task_state spawning.
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-unplugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] No waiting events found dispatching network-vif-unplugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:44 user nova-compute[73012]: WARNING nova.compute.manager [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received unexpected event network-vif-unplugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d for instance with vm_state active and task_state rebuilding.
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] No waiting events found dispatching network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:44 user nova-compute[73012]: WARNING nova.compute.manager [req-94508b5d-6793-4f82-b172-b8728eb97c3b req-3f09f92e-801e-4d98-985d-f466a3950c25 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received unexpected event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d for instance with vm_state active and task_state rebuilding.
Aug 14 12:14:44 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Instance destroyed successfully.
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015285.0172374, 634acb0d-490b-4b60-b4f3-947ee8e17457 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] VM Resumed (Lifecycle Event)
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.compute.manager [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Detaching volume 1d15a83c-3596-476f-a2c3-a3857a560a5e
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance spawned successfully.
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015285.0180557, 634acb0d-490b-4b60-b4f3-947ee8e17457 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] VM Started (Lifecycle Event)
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.virt.block_device [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Attempting to driver detach volume 1d15a83c-3596-476f-a2c3-a3857a560a5e from mountpoint /dev/vdb
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Attempting to detach device vdb from instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:14:45 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:14:45 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:14:45 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:14:45 user nova-compute[73012]:   <serial>1d15a83c-3596-476f-a2c3-a3857a560a5e</serial>
Aug 14 12:14:45 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:14:45 user nova-compute[73012]: </disk>
Aug 14 12:14:45 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully detached device vdb from instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 from the persistent domain config.
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQraqtTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:14:45 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5239a5-96a5-49ad-9707-2870e7051ca0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7442186e-1414-41fd-9be9-e6b395d11725]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:45 user nova-compute[73012]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:14:45 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:45 user nova-compute[73012]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:14:45 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0149090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d355a218-d3ec-4c01-9d51-d484704103f6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a32f1f4-9262-49e0-bcba-927c2ee7a265]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:14:45 user nova-compute[73012]: INFO nova.compute.manager [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Took 15.90 seconds to build instance.
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08f3445-f781-44e0-8646-753046003114]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48adb48-64a7-4418-80f0-e69c5a100be7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a7de1b-51ba-40a3-a27e-7c9ef7f5232e]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd4fe8d-82c4-4bf2-98f1-e8eaf6fd59ef]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9634012f-916f-43bf-a414-5a444bd36ef2]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260]
Aug 14 12:14:45 user nova-compute[73012]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260] successful.
Aug 14 12:14:45 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf40668-e7a9-436a-8a33-fef31565c6ba]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== disconnect_volume: return (297ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:14:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:46 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Instance destroyed successfully.
Aug 14 12:14:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993015962',display_name='tempest-ServerActionsTestOtherA-server-1065965344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993015962',id=21,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtgn7jI0ij2H9jUYjkccKsYICC7IYYfLPdrPhf/txsC9h/wIuzHlUOu4tO1XNh3I/gHCdax/I0yp+dw9TF/JX47JXH1n7A4tRx6CChv+xyFdBvhBqcME74oyp+lIXw0hQ==',key_name='tempest-keypair-427987902',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-k5j0guq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=0d1c12d3-8962-49e8-8ad5-071caee70b94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_vif [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3cb9338-9b, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:14:46 user nova-compute[73012]: INFO os_vif [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b')
Aug 14 12:14:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQraqtTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:14:46 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e7f2a9-b30f-4599-868b-ecbac22c6d9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba20e322-f445-4088-b194-50a0a5f9b985]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad014ab00>, {}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Disconnecting from: [] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.044s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== disconnect_volume: return (45ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:14:46 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Deleting instance files /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94_del
Aug 14 12:14:46 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Deletion of /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94_del complete
Aug 14 12:14:46 user nova-compute[73012]: INFO nova.virt.block_device [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Booting with volume 1d15a83c-3596-476f-a2c3-a3857a560a5e at /dev/vdb
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.utils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc48b0-e310-4140-988c-07270462ec24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc4ad75-3758-4145-a8d9-3fda1f31e9bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90e3e81-ea81-435a-b63a-3766ae4d9244]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a32996-3132-4f12-9adb-0f2f4791bd1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:14:46 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:14:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11f275-aa35-4842-a6b1-089a77c3888a]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG os_brick.utils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:14:46 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Updating existing volume attachment record: d74f2205-a6ff-43cf-abc5-c866e0e79dff {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:14:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-b8b2c7e2-e8f6-41cd-b297-8fbcdd4ba6ee req-2642b6a5-db6c-4355-835f-e3a3e8f0c949 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-changed-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-b8b2c7e2-e8f6-41cd-b297-8fbcdd4ba6ee req-2642b6a5-db6c-4355-835f-e3a3e8f0c949 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Refreshing instance network info cache due to event network-changed-c652878c-a896-4c3f-8108-ec1157747dd8. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:14:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b8b2c7e2-e8f6-41cd-b297-8fbcdd4ba6ee req-2642b6a5-db6c-4355-835f-e3a3e8f0c949 service nova] Acquiring lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:14:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b8b2c7e2-e8f6-41cd-b297-8fbcdd4ba6ee req-2642b6a5-db6c-4355-835f-e3a3e8f0c949 service nova] Acquired lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:14:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-b8b2c7e2-e8f6-41cd-b297-8fbcdd4ba6ee req-2642b6a5-db6c-4355-835f-e3a3e8f0c949 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Refreshing network info cache for port c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:14:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-b8b2c7e2-e8f6-41cd-b297-8fbcdd4ba6ee req-2642b6a5-db6c-4355-835f-e3a3e8f0c949 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updated VIF entry in instance network info cache for port c652878c-a896-4c3f-8108-ec1157747dd8. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:14:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-b8b2c7e2-e8f6-41cd-b297-8fbcdd4ba6ee req-2642b6a5-db6c-4355-835f-e3a3e8f0c949 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating instance_info_cache with network_info: [{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:14:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b8b2c7e2-e8f6-41cd-b297-8fbcdd4ba6ee req-2642b6a5-db6c-4355-835f-e3a3e8f0c949 service nova] Releasing lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:14:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:55 user nova-compute[73012]: INFO nova.compute.manager [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Shelving
Aug 14 12:14:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:55 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance destroyed successfully.
Aug 14 12:14:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-c0bee28b-6475-4585-9124-d1529d8bcd1c req-9182c299-f654-4983-9218-c20a6a9fd4f3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-unplugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c0bee28b-6475-4585-9124-d1529d8bcd1c req-9182c299-f654-4983-9218-c20a6a9fd4f3 service nova] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c0bee28b-6475-4585-9124-d1529d8bcd1c req-9182c299-f654-4983-9218-c20a6a9fd4f3 service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c0bee28b-6475-4585-9124-d1529d8bcd1c req-9182c299-f654-4983-9218-c20a6a9fd4f3 service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-c0bee28b-6475-4585-9124-d1529d8bcd1c req-9182c299-f654-4983-9218-c20a6a9fd4f3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] No waiting events found dispatching network-vif-unplugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:55 user nova-compute[73012]: WARNING nova.compute.manager [req-c0bee28b-6475-4585-9124-d1529d8bcd1c req-9182c299-f654-4983-9218-c20a6a9fd4f3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received unexpected event network-vif-unplugged-c652878c-a896-4c3f-8108-ec1157747dd8 for instance with vm_state active and task_state shelving.
Aug 14 12:14:55 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Beginning cold snapshot process
Aug 14 12:14:56 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:14:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk /opt/stack/data/nova/instances/snapshots/tmpwfcbgo_m/099333179d124dfe9cd1cc733ae66e41 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk /opt/stack/data/nova/instances/snapshots/tmpwfcbgo_m/099333179d124dfe9cd1cc733ae66e41" returned: 0 in 1.034s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:57 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Snapshot extracted, beginning image upload
Aug 14 12:14:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:14:57 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Creating image(s)
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk 1073741824" returned: 0 in 0.061s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-6ef40ddc-752c-410d-92ef-906815ef5081 req-1ba6cc6b-2a95-4345-b61b-7684f592178a service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6ef40ddc-752c-410d-92ef-906815ef5081 req-1ba6cc6b-2a95-4345-b61b-7684f592178a service nova] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6ef40ddc-752c-410d-92ef-906815ef5081 req-1ba6cc6b-2a95-4345-b61b-7684f592178a service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6ef40ddc-752c-410d-92ef-906815ef5081 req-1ba6cc6b-2a95-4345-b61b-7684f592178a service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-6ef40ddc-752c-410d-92ef-906815ef5081 req-1ba6cc6b-2a95-4345-b61b-7684f592178a service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] No waiting events found dispatching network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:14:57 user nova-compute[73012]: WARNING nova.compute.manager [req-6ef40ddc-752c-410d-92ef-906815ef5081 req-1ba6cc6b-2a95-4345-b61b-7684f592178a service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received unexpected event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Cannot resize image /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Ensure instance console log exists: /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Start _get_guest_xml network_info=[{"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQraqtTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0d1c12d3-8962-49e8-8ad5-071caee70b94', 'attached_at': '', 'detached_at': '', 'volume_id': '1d15a83c-3596-476f-a2c3-a3857a560a5e', 'serial': '1d15a83c-3596-476f-a2c3-a3857a560a5e'}, 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'd74f2205-a6ff-43cf-abc5-c866e0e79dff', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:14:58 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 12:14:58 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQraqtTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:14:58 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:14:58 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:14:58 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[82913ca0-3526-4bd9-aa00-4c9224413b5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:14:58 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9267f8e-58b8-4c45-8f32-37a9a35f8e7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e] added
Aug 14 12:14:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b0834-70dc-4836-8c52-2d74ddda733b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e21943-1156-4e04-921b-5be17d124389]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQraqtTd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQraqtTd" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d52395-8729-46e8-9fe9-03d5652ecf1b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQraqtTd'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5525e0-8bb7-4fef-8568-d11799313699]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[000f793d-0039-4343-81b4-b3c2f8cdda7e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7316b89d-20a2-4058-b987-74995cc6cf1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260]
Aug 14 12:14:58 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260] successful.
Aug 14 12:14:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be168c1-91eb-4763-b5c0-b9425fdd2911]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc151483-4ffd-4cb7-a3dd-0509e9575632]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:58 user nova-compute[73012]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:14:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:14:58 user nova-compute[73012]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:14:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ba363c-9057-4268-a5d4-8c4e2c2212a5]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:14:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQraqtTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:14:58 user nova-compute[73012]: INFO nova.compute.manager [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] instance snapshotting
Aug 14 12:14:58 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Beginning live snapshot process
Aug 14 12:14:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json -f qcow2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json -f qcow2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23238396237666236', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238396237666236', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.250s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0qbm2o9s/361ae344bf26449682985a6d318dddf4.delta 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993015962',display_name='tempest-ServerActionsTestOtherA-server-1065965344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993015962',id=21,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtgn7jI0ij2H9jUYjkccKsYICC7IYYfLPdrPhf/txsC9h/wIuzHlUOu4tO1XNh3I/gHCdax/I0yp+dw9TF/JX47JXH1n7A4tRx6CChv+xyFdBvhBqcME74oyp+lIXw0hQ==',key_name='tempest-keypair-427987902',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-k5j0guq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=0d1c12d3-8962-49e8-8ad5-071caee70b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:14:59 user nova-compute[73012]:   <uuid>0d1c12d3-8962-49e8-8ad5-071caee70b94</uuid>
Aug 14 12:14:59 user nova-compute[73012]:   <name>instance-00000015</name>
Aug 14 12:14:59 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:14:59 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:14:59 user nova-compute[73012]:   <metadata>
Aug 14 12:14:59 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:14:59 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:14:59 user nova-compute[73012]:       <nova:name>tempest-ServerActionsTestOtherA-server-1065965344</nova:name>
Aug 14 12:14:59 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:14:58</nova:creationTime>
Aug 14 12:14:59 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:14:59 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:14:59 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:14:59 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:14:59 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:14:59 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:14:59 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:14:59 user nova-compute[73012]:       <nova:owner>
Aug 14 12:14:59 user nova-compute[73012]:         <nova:user uuid="7d6c467aee6140bda719332345af7ec0">tempest-ServerActionsTestOtherA-975401032-project-member</nova:user>
Aug 14 12:14:59 user nova-compute[73012]:         <nova:project uuid="33d5064d145e48eab20dc7ee82bdf779">tempest-ServerActionsTestOtherA-975401032</nova:project>
Aug 14 12:14:59 user nova-compute[73012]:       </nova:owner>
Aug 14 12:14:59 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:14:59 user nova-compute[73012]:       <nova:ports>
Aug 14 12:14:59 user nova-compute[73012]:         <nova:port uuid="a3cb9338-9b9e-48ed-9da8-1cef3094170d">
Aug 14 12:14:59 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 12:14:59 user nova-compute[73012]:         </nova:port>
Aug 14 12:14:59 user nova-compute[73012]:       </nova:ports>
Aug 14 12:14:59 user nova-compute[73012]:     </nova:instance>
Aug 14 12:14:59 user nova-compute[73012]:   </metadata>
Aug 14 12:14:59 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:14:59 user nova-compute[73012]:     <system>
Aug 14 12:14:59 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:14:59 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:14:59 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:14:59 user nova-compute[73012]:       <entry name="serial">0d1c12d3-8962-49e8-8ad5-071caee70b94</entry>
Aug 14 12:14:59 user nova-compute[73012]:       <entry name="uuid">0d1c12d3-8962-49e8-8ad5-071caee70b94</entry>
Aug 14 12:14:59 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:14:59 user nova-compute[73012]:     </system>
Aug 14 12:14:59 user nova-compute[73012]:   </sysinfo>
Aug 14 12:14:59 user nova-compute[73012]:   <os>
Aug 14 12:14:59 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:14:59 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:14:59 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:14:59 user nova-compute[73012]:   </os>
Aug 14 12:14:59 user nova-compute[73012]:   <features>
Aug 14 12:14:59 user nova-compute[73012]:     <acpi/>
Aug 14 12:14:59 user nova-compute[73012]:     <apic/>
Aug 14 12:14:59 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:14:59 user nova-compute[73012]:   </features>
Aug 14 12:14:59 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:14:59 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:14:59 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:14:59 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:14:59 user nova-compute[73012]:   </clock>
Aug 14 12:14:59 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:14:59 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:14:59 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:14:59 user nova-compute[73012]:   </cpu>
Aug 14 12:14:59 user nova-compute[73012]:   <devices>
Aug 14 12:14:59 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:14:59 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:14:59 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk"/>
Aug 14 12:14:59 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:14:59 user nova-compute[73012]:     </disk>
Aug 14 12:14:59 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:14:59 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:14:59 user nova-compute[73012]:       <source dev="/dev/sdc"/>
Aug 14 12:14:59 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:14:59 user nova-compute[73012]:       <serial>1d15a83c-3596-476f-a2c3-a3857a560a5e</serial>
Aug 14 12:14:59 user nova-compute[73012]:     </disk>
Aug 14 12:14:59 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:14:59 user nova-compute[73012]:       <mac address="fa:16:3e:07:9f:e3"/>
Aug 14 12:14:59 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:14:59 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:14:59 user nova-compute[73012]:       <target dev="tapa3cb9338-9b"/>
Aug 14 12:14:59 user nova-compute[73012]:     </interface>
Aug 14 12:14:59 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:14:59 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/console.log" append="off"/>
Aug 14 12:14:59 user nova-compute[73012]:     </serial>
Aug 14 12:14:59 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:14:59 user nova-compute[73012]:     <video>
Aug 14 12:14:59 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:14:59 user nova-compute[73012]:     </video>
Aug 14 12:14:59 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:14:59 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:14:59 user nova-compute[73012]:     </rng>
Aug 14 12:14:59 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:14:59 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:14:59 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:14:59 user nova-compute[73012]:     </memballoon>
Aug 14 12:14:59 user nova-compute[73012]:   </devices>
Aug 14 12:14:59 user nova-compute[73012]: </domain>
Aug 14 12:14:59 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993015962',display_name='tempest-ServerActionsTestOtherA-server-1065965344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993015962',id=21,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtgn7jI0ij2H9jUYjkccKsYICC7IYYfLPdrPhf/txsC9h/wIuzHlUOu4tO1XNh3I/gHCdax/I0yp+dw9TF/JX47JXH1n7A4tRx6CChv+xyFdBvhBqcME74oyp+lIXw0hQ==',key_name='tempest-keypair-427987902',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:12:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-k5j0guq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:14:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=0d1c12d3-8962-49e8-8ad5-071caee70b94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG os_vif [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0qbm2o9s/361ae344bf26449682985a6d318dddf4.delta 1073741824" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:14:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 12:14:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3cb9338-9b, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3cb9338-9b, col_values=(('external_ids', {'iface-id': 'a3cb9338-9b9e-48ed-9da8-1cef3094170d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:9f:e3', 'vm-uuid': '0d1c12d3-8962-49e8-8ad5-071caee70b94'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:14:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:14:59 user nova-compute[73012]: INFO os_vif [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b')
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015284.9000506, 0d1c12d3-8962-49e8-8ad5-071caee70b94 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:14:59 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] VM Stopped (Lifecycle Event)
Aug 14 12:14:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-15e36351-f6dc-495a-a1b5-475f030d4544 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:15:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:15:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No VIF found with MAC fa:16:3e:07:9f:e3, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:15:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Snapshot image upload complete
Aug 14 12:15:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:00 user nova-compute[73012]: INFO nova.compute.manager [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Shelve offloading
Aug 14 12:15:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance destroyed successfully.
Aug 14 12:15:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:15:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquired lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:15:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:15:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:15:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] COPY block job progress, current cursor: 17498112 final cursor: 75497472 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:15:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating instance_info_cache with network_info: [{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:15:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Releasing lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:15:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 12:15:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0qbm2o9s/361ae344bf26449682985a6d318dddf4.delta /opt/stack/data/nova/instances/snapshots/tmp0qbm2o9s/361ae344bf26449682985a6d318dddf4 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance destroyed successfully.
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'resources' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-1a3565c2-344a-4422-9855-941fda9094c5 req-f080bfb9-6440-4cf5-9f0c-b1f9ef0a23b8 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-changed-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-1a3565c2-344a-4422-9855-941fda9094c5 req-f080bfb9-6440-4cf5-9f0c-b1f9ef0a23b8 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Refreshing instance network info cache due to event network-changed-c652878c-a896-4c3f-8108-ec1157747dd8. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1a3565c2-344a-4422-9855-941fda9094c5 req-f080bfb9-6440-4cf5-9f0c-b1f9ef0a23b8 service nova] Acquiring lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1a3565c2-344a-4422-9855-941fda9094c5 req-f080bfb9-6440-4cf5-9f0c-b1f9ef0a23b8 service nova] Acquired lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-1a3565c2-344a-4422-9855-941fda9094c5 req-f080bfb9-6440-4cf5-9f0c-b1f9ef0a23b8 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Refreshing network info cache for port c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-838748235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-838748235',id=22,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV5mRNytxsnHEHhX2uJ4TIFUR6h3MrD/JjWu07t8+cOMMt8KeSmdhu7LxlHAmPyRFLqS8Z5Vg9nlht/gXkJmEiwnTatdpAZwx6xjN1iITv9/VgSvjTaPrb/5C0hzuXLmg==',key_name='tempest-keypair-859094030',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:13:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-f2gn3cvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member',shelved_at='2023-08-14T12:15:00.602120',shelved_host='user',shelved_image_id='8d9c1944-34ea-4357-86ba-3d85fdbfea52'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=cfa2f996-7907-4490-84d6-c04c5d0ca6e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG os_vif [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc652878c-a8, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:15:02 user nova-compute[73012]: INFO os_vif [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8')
Aug 14 12:15:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Deleting instance files /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5_del
Aug 14 12:15:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Deletion of /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5_del complete
Aug 14 12:15:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-1dfc2b98-e942-431a-a5dd-c4fc9fdeb301 req-256251a4-2915-484b-bbac-5b7e896cd08e service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1dfc2b98-e942-431a-a5dd-c4fc9fdeb301 req-256251a4-2915-484b-bbac-5b7e896cd08e service nova] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1dfc2b98-e942-431a-a5dd-c4fc9fdeb301 req-256251a4-2915-484b-bbac-5b7e896cd08e service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1dfc2b98-e942-431a-a5dd-c4fc9fdeb301 req-256251a4-2915-484b-bbac-5b7e896cd08e service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-1dfc2b98-e942-431a-a5dd-c4fc9fdeb301 req-256251a4-2915-484b-bbac-5b7e896cd08e service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] No waiting events found dispatching network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:15:02 user nova-compute[73012]: WARNING nova.compute.manager [req-1dfc2b98-e942-431a-a5dd-c4fc9fdeb301 req-256251a4-2915-484b-bbac-5b7e896cd08e service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received unexpected event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d for instance with vm_state active and task_state rebuild_spawning.
Aug 14 12:15:02 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Deleted allocations for instance cfa2f996-7907-4490-84d6-c04c5d0ca6e5
Aug 14 12:15:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'numa_topology' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:15:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0qbm2o9s/361ae344bf26449682985a6d318dddf4.delta /opt/stack/data/nova/instances/snapshots/tmp0qbm2o9s/361ae344bf26449682985a6d318dddf4" returned: 0 in 0.676s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Snapshot extracted, beginning image upload
Aug 14 12:15:03 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:15:03 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:15:03 user nova-compute[73012]: DEBUG nova.network.neutron [req-1a3565c2-344a-4422-9855-941fda9094c5 req-f080bfb9-6440-4cf5-9f0c-b1f9ef0a23b8 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updated VIF entry in instance network info cache for port c652878c-a896-4c3f-8108-ec1157747dd8. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:15:03 user nova-compute[73012]: DEBUG nova.network.neutron [req-1a3565c2-344a-4422-9855-941fda9094c5 req-f080bfb9-6440-4cf5-9f0c-b1f9ef0a23b8 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating instance_info_cache with network_info: [{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc652878c-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:15:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1a3565c2-344a-4422-9855-941fda9094c5 req-f080bfb9-6440-4cf5-9f0c-b1f9ef0a23b8 service nova] Releasing lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:15:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dea3028f-0eda-43c6-b6c0-9b6eb09cd9f1 tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.423s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-1459ab61-b019-4132-be46-a105075e9449 req-bb2d6039-6808-43d0-a7f3-9450840afb4c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:15:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1459ab61-b019-4132-be46-a105075e9449 req-bb2d6039-6808-43d0-a7f3-9450840afb4c service nova] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1459ab61-b019-4132-be46-a105075e9449 req-bb2d6039-6808-43d0-a7f3-9450840afb4c service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1459ab61-b019-4132-be46-a105075e9449 req-bb2d6039-6808-43d0-a7f3-9450840afb4c service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-1459ab61-b019-4132-be46-a105075e9449 req-bb2d6039-6808-43d0-a7f3-9450840afb4c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] No waiting events found dispatching network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:15:04 user nova-compute[73012]: WARNING nova.compute.manager [req-1459ab61-b019-4132-be46-a105075e9449 req-bb2d6039-6808-43d0-a7f3-9450840afb4c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received unexpected event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d for instance with vm_state active and task_state rebuild_spawning.
Aug 14 12:15:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015305.2909284, 0d1c12d3-8962-49e8-8ad5-071caee70b94 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:15:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] VM Resumed (Lifecycle Event)
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:15:05 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Instance spawned successfully.
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015305.295833, 0d1c12d3-8962-49e8-8ad5-071caee70b94 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:15:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] VM Started (Lifecycle Event)
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:15:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG nova.objects.instance [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73012) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 12:15:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-46340be2-1e31-4fa2-b216-fcd1f1d4935c tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.109s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Snapshot image upload complete
Aug 14 12:15:06 user nova-compute[73012]: INFO nova.compute.manager [None req-7a2e1104-c785-461d-857a-f7c37799365f tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Took 8.26 seconds to snapshot the instance on the hypervisor.
Aug 14 12:15:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:10 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015295.7451715, cfa2f996-7907-4490-84d6-c04c5d0ca6e5 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:15:10 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] VM Stopped (Lifecycle Event)
Aug 14 12:15:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4721984e-4943-411e-901b-a958bc8e084c None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:30 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:15:33 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:33 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:33 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:15:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:15:34 user nova-compute[73012]: INFO nova.compute.claims [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Claim successful on node user
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:15:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:15:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:15:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Creating image(s)
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "/opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "/opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG nova.policy [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ec55f1fbed1454897cf3728940769aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0feef8d407c74fd092548ee5ffc0afda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.222s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk 1073741824" returned: 0 in 0.062s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:15:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Cannot resize image /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'migration_context' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Ensure instance console log exists: /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Successfully created port: 2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Successfully updated port: 2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-54c604ca-b726-407e-86e5-4965711662c3 req-b9f9ce44-02ab-4d91-b7a9-1bc32a170033 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received event network-changed-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-54c604ca-b726-407e-86e5-4965711662c3 req-b9f9ce44-02ab-4d91-b7a9-1bc32a170033 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Refreshing instance network info cache due to event network-changed-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54c604ca-b726-407e-86e5-4965711662c3 req-b9f9ce44-02ab-4d91-b7a9-1bc32a170033 service nova] Acquiring lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54c604ca-b726-407e-86e5-4965711662c3 req-b9f9ce44-02ab-4d91-b7a9-1bc32a170033 service nova] Acquired lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.network.neutron [req-54c604ca-b726-407e-86e5-4965711662c3 req-b9f9ce44-02ab-4d91-b7a9-1bc32a170033 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Refreshing network info cache for port 2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:15:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:15:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7691MB free_disk=25.548736572265625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.network.neutron [req-54c604ca-b726-407e-86e5-4965711662c3 req-b9f9ce44-02ab-4d91-b7a9-1bc32a170033 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 634acb0d-490b-4b60-b4f3-947ee8e17457 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.network.neutron [req-54c604ca-b726-407e-86e5-4965711662c3 req-b9f9ce44-02ab-4d91-b7a9-1bc32a170033 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54c604ca-b726-407e-86e5-4965711662c3 req-b9f9ce44-02ab-4d91-b7a9-1bc32a170033 service nova] Releasing lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquired lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:15:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updating instance_info_cache with network_info: [{"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Releasing lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Instance network_info: |[{"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Start _get_guest_xml network_info=[{"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:15:38 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:15:38 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1326648969',display_name='tempest-SnapshotDataIntegrityTests-server-1326648969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1326648969',id=25,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQMndKv1VMriU6eBduh40Gs2PBgxe+7X/0vmDPO7Pn9jFjlMp0BXAfYJTLA++HLigmGzmXaVtxQM5sxPNSoIn/zInQjij59mIl7V6s/sSFFGVsc9tUWX3qzkBcGKUCAlQ==',key_name='tempest-keypair-1675037495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0feef8d407c74fd092548ee5ffc0afda',ramdisk_id='',reservation_id='r-z1yychxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-367344780',owner_user_name='tempest-SnapshotDataIntegrityTests-367344780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec55f1fbed1454897cf3728940769aa',uuid=8e51a9ce-cd61-4c43-a297-7f313bf2a07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Converting VIF {"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a,network=Network(8e23759d-a738-434d-93a0-da729ce1a4ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0c43af-6f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:15:38 user nova-compute[73012]:   <uuid>8e51a9ce-cd61-4c43-a297-7f313bf2a07c</uuid>
Aug 14 12:15:38 user nova-compute[73012]:   <name>instance-00000019</name>
Aug 14 12:15:38 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:15:38 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:15:38 user nova-compute[73012]:   <metadata>
Aug 14 12:15:38 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:15:38 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:15:38 user nova-compute[73012]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1326648969</nova:name>
Aug 14 12:15:38 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:15:38</nova:creationTime>
Aug 14 12:15:38 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:15:38 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:15:38 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:15:38 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:15:38 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:15:38 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:15:38 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:15:38 user nova-compute[73012]:       <nova:owner>
Aug 14 12:15:38 user nova-compute[73012]:         <nova:user uuid="6ec55f1fbed1454897cf3728940769aa">tempest-SnapshotDataIntegrityTests-367344780-project-member</nova:user>
Aug 14 12:15:38 user nova-compute[73012]:         <nova:project uuid="0feef8d407c74fd092548ee5ffc0afda">tempest-SnapshotDataIntegrityTests-367344780</nova:project>
Aug 14 12:15:38 user nova-compute[73012]:       </nova:owner>
Aug 14 12:15:38 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:15:38 user nova-compute[73012]:       <nova:ports>
Aug 14 12:15:38 user nova-compute[73012]:         <nova:port uuid="2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a">
Aug 14 12:15:38 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 12:15:38 user nova-compute[73012]:         </nova:port>
Aug 14 12:15:38 user nova-compute[73012]:       </nova:ports>
Aug 14 12:15:38 user nova-compute[73012]:     </nova:instance>
Aug 14 12:15:38 user nova-compute[73012]:   </metadata>
Aug 14 12:15:38 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:15:38 user nova-compute[73012]:     <system>
Aug 14 12:15:38 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:15:38 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:15:38 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:15:38 user nova-compute[73012]:       <entry name="serial">8e51a9ce-cd61-4c43-a297-7f313bf2a07c</entry>
Aug 14 12:15:38 user nova-compute[73012]:       <entry name="uuid">8e51a9ce-cd61-4c43-a297-7f313bf2a07c</entry>
Aug 14 12:15:38 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:15:38 user nova-compute[73012]:     </system>
Aug 14 12:15:38 user nova-compute[73012]:   </sysinfo>
Aug 14 12:15:38 user nova-compute[73012]:   <os>
Aug 14 12:15:38 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:15:38 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:15:38 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:15:38 user nova-compute[73012]:   </os>
Aug 14 12:15:38 user nova-compute[73012]:   <features>
Aug 14 12:15:38 user nova-compute[73012]:     <acpi/>
Aug 14 12:15:38 user nova-compute[73012]:     <apic/>
Aug 14 12:15:38 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:15:38 user nova-compute[73012]:   </features>
Aug 14 12:15:38 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:15:38 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:15:38 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:15:38 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:15:38 user nova-compute[73012]:   </clock>
Aug 14 12:15:38 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:15:38 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:15:38 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:15:38 user nova-compute[73012]:   </cpu>
Aug 14 12:15:38 user nova-compute[73012]:   <devices>
Aug 14 12:15:38 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:15:38 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:15:38 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk"/>
Aug 14 12:15:38 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:15:38 user nova-compute[73012]:     </disk>
Aug 14 12:15:38 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:15:38 user nova-compute[73012]:       <mac address="fa:16:3e:2d:27:fb"/>
Aug 14 12:15:38 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:15:38 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:15:38 user nova-compute[73012]:       <target dev="tap2a0c43af-6f"/>
Aug 14 12:15:38 user nova-compute[73012]:     </interface>
Aug 14 12:15:38 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:15:38 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/console.log" append="off"/>
Aug 14 12:15:38 user nova-compute[73012]:     </serial>
Aug 14 12:15:38 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:15:38 user nova-compute[73012]:     <video>
Aug 14 12:15:38 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:15:38 user nova-compute[73012]:     </video>
Aug 14 12:15:38 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:15:38 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:15:38 user nova-compute[73012]:     </rng>
Aug 14 12:15:38 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:15:38 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:15:38 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:15:38 user nova-compute[73012]:     </memballoon>
Aug 14 12:15:38 user nova-compute[73012]:   </devices>
Aug 14 12:15:38 user nova-compute[73012]: </domain>
Aug 14 12:15:38 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1326648969',display_name='tempest-SnapshotDataIntegrityTests-server-1326648969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1326648969',id=25,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQMndKv1VMriU6eBduh40Gs2PBgxe+7X/0vmDPO7Pn9jFjlMp0BXAfYJTLA++HLigmGzmXaVtxQM5sxPNSoIn/zInQjij59mIl7V6s/sSFFGVsc9tUWX3qzkBcGKUCAlQ==',key_name='tempest-keypair-1675037495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0feef8d407c74fd092548ee5ffc0afda',ramdisk_id='',reservation_id='r-z1yychxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-367344780',owner_user_name='tempest-SnapshotDataIntegrityTests-367344780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec55f1fbed1454897cf3728940769aa',uuid=8e51a9ce-cd61-4c43-a297-7f313bf2a07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Converting VIF {"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a,network=Network(8e23759d-a738-434d-93a0-da729ce1a4ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0c43af-6f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG os_vif [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a,network=Network(8e23759d-a738-434d-93a0-da729ce1a4ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0c43af-6f') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a0c43af-6f, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a0c43af-6f, col_values=(('external_ids', {'iface-id': '2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:27:fb', 'vm-uuid': '8e51a9ce-cd61-4c43-a297-7f313bf2a07c'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:38 user nova-compute[73012]: INFO os_vif [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a,network=Network(8e23759d-a738-434d-93a0-da729ce1a4ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0c43af-6f')
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No VIF found with MAC fa:16:3e:2d:27:fb, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:38 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:15:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:15:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:15:39 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:15:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:39 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Updating instance_info_cache with network_info: [{"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-02c29258-4e4d-4ed3-a26b-7b59315f94cf req-b764f4d9-dade-4af2-808a-e9d5610461c8 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received event network-vif-plugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-02c29258-4e4d-4ed3-a26b-7b59315f94cf req-b764f4d9-dade-4af2-808a-e9d5610461c8 service nova] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-02c29258-4e4d-4ed3-a26b-7b59315f94cf req-b764f4d9-dade-4af2-808a-e9d5610461c8 service nova] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-02c29258-4e4d-4ed3-a26b-7b59315f94cf req-b764f4d9-dade-4af2-808a-e9d5610461c8 service nova] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-02c29258-4e4d-4ed3-a26b-7b59315f94cf req-b764f4d9-dade-4af2-808a-e9d5610461c8 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] No waiting events found dispatching network-vif-plugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:15:40 user nova-compute[73012]: WARNING nova.compute.manager [req-02c29258-4e4d-4ed3-a26b-7b59315f94cf req-b764f4d9-dade-4af2-808a-e9d5610461c8 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received unexpected event network-vif-plugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a for instance with vm_state building and task_state spawning.
Aug 14 12:15:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:41 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015341.968284, 8e51a9ce-cd61-4c43-a297-7f313bf2a07c => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:15:41 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] VM Resumed (Lifecycle Event)
Aug 14 12:15:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:15:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:15:41 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Instance spawned successfully.
Aug 14 12:15:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:15:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:15:42 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015341.9696019, 8e51a9ce-cd61-4c43-a297-7f313bf2a07c => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:15:42 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] VM Started (Lifecycle Event)
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:15:42 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:15:42 user nova-compute[73012]: INFO nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-3c82c272-5bab-4a41-a0c4-b6b9546945f9 req-4fdf94de-9f75-44a8-a2d3-751552cbb11f service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received event network-vif-plugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3c82c272-5bab-4a41-a0c4-b6b9546945f9 req-4fdf94de-9f75-44a8-a2d3-751552cbb11f service nova] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3c82c272-5bab-4a41-a0c4-b6b9546945f9 req-4fdf94de-9f75-44a8-a2d3-751552cbb11f service nova] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3c82c272-5bab-4a41-a0c4-b6b9546945f9 req-4fdf94de-9f75-44a8-a2d3-751552cbb11f service nova] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-3c82c272-5bab-4a41-a0c4-b6b9546945f9 req-4fdf94de-9f75-44a8-a2d3-751552cbb11f service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] No waiting events found dispatching network-vif-plugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:15:42 user nova-compute[73012]: WARNING nova.compute.manager [req-3c82c272-5bab-4a41-a0c4-b6b9546945f9 req-4fdf94de-9f75-44a8-a2d3-751552cbb11f service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received unexpected event network-vif-plugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a for instance with vm_state active and task_state None.
Aug 14 12:15:42 user nova-compute[73012]: INFO nova.compute.manager [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Took 7.88 seconds to build instance.
Aug 14 12:15:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e3719e3b-e561-4f4f-891e-1322a8e33a96 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.990s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:57 user nova-compute[73012]: INFO nova.compute.manager [None req-b0c1a042-47f9-40a8-8342-7cf6b3d94884 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Unrescuing
Aug 14 12:15:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b0c1a042-47f9-40a8-8342-7cf6b3d94884 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:15:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b0c1a042-47f9-40a8-8342-7cf6b3d94884 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquired lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:15:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-b0c1a042-47f9-40a8-8342-7cf6b3d94884 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:15:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-b0c1a042-47f9-40a8-8342-7cf6b3d94884 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updating instance_info_cache with network_info: [{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:15:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b0c1a042-47f9-40a8-8342-7cf6b3d94884 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Releasing lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:15:57 user nova-compute[73012]: DEBUG nova.objects.instance [None req-b0c1a042-47f9-40a8-8342-7cf6b3d94884 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'flavor' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:15:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-bb50f7b1-45e4-4061-8ba1-538a7cc21a48 req-2f1e7ac7-dafb-44ac-ba3f-acf264d981d3 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-unplugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:15:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bb50f7b1-45e4-4061-8ba1-538a7cc21a48 req-2f1e7ac7-dafb-44ac-ba3f-acf264d981d3 service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:15:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bb50f7b1-45e4-4061-8ba1-538a7cc21a48 req-2f1e7ac7-dafb-44ac-ba3f-acf264d981d3 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:15:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bb50f7b1-45e4-4061-8ba1-538a7cc21a48 req-2f1e7ac7-dafb-44ac-ba3f-acf264d981d3 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:15:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-bb50f7b1-45e4-4061-8ba1-538a7cc21a48 req-2f1e7ac7-dafb-44ac-ba3f-acf264d981d3 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-unplugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:15:58 user nova-compute[73012]: WARNING nova.compute.manager [req-bb50f7b1-45e4-4061-8ba1-538a7cc21a48 req-2f1e7ac7-dafb-44ac-ba3f-acf264d981d3 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-unplugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:15:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:15:58 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Instance destroyed successfully.
Aug 14 12:16:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-c424b68f-a6a1-4de9-b30e-a075ed064377 req-26634dd0-2b16-47b3-9fdf-a0035955d02e service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c424b68f-a6a1-4de9-b30e-a075ed064377 req-26634dd0-2b16-47b3-9fdf-a0035955d02e service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c424b68f-a6a1-4de9-b30e-a075ed064377 req-26634dd0-2b16-47b3-9fdf-a0035955d02e service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c424b68f-a6a1-4de9-b30e-a075ed064377 req-26634dd0-2b16-47b3-9fdf-a0035955d02e service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-c424b68f-a6a1-4de9-b30e-a075ed064377 req-26634dd0-2b16-47b3-9fdf-a0035955d02e service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:16:00 user nova-compute[73012]: WARNING nova.compute.manager [req-c424b68f-a6a1-4de9-b30e-a075ed064377 req-26634dd0-2b16-47b3-9fdf-a0035955d02e service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:16:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:16:02 user nova-compute[73012]: WARNING nova.compute.manager [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:16:02 user nova-compute[73012]: WARNING nova.compute.manager [req-2438813b-c4ae-4fa1-ab9b-010be01ee700 req-d1badce9-ccd1-494f-b779-65eb1058f6cf service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for c2247c01-f5c8-42f3-9f16-231e7198d4e8 due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015362.5175097, c2247c01-f5c8-42f3-9f16-231e7198d4e8 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:16:02 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] VM Resumed (Lifecycle Event)
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b0c1a042-47f9-40a8-8342-7cf6b3d94884 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:16:02 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015362.5194538, c2247c01-f5c8-42f3-9f16-231e7198d4e8 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:16:02 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] VM Started (Lifecycle Event)
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:16:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:16:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:16:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:16:09 user nova-compute[73012]: INFO nova.compute.claims [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Claim successful on node user
Aug 14 12:16:10 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:16:10 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:16:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:16:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:16:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:16:10 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:16:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:16:10 user nova-compute[73012]: INFO nova.virt.block_device [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Booting with blank volume at /dev/vda
Aug 14 12:16:10 user nova-compute[73012]: DEBUG nova.policy [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae1ce3345617447486642ebe88c1621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1960abc96445f483386773f67d83e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:16:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Successfully created port: f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Successfully updated port: f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquired lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-56d2f795-f600-40e2-b34f-e1368336c34e req-0954e6c1-368c-4c43-931d-c62298071852 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-changed-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-56d2f795-f600-40e2-b34f-e1368336c34e req-0954e6c1-368c-4c43-931d-c62298071852 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Refreshing instance network info cache due to event network-changed-f1955c5d-ee34-4117-b651-daa2cc4b5002. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-56d2f795-f600-40e2-b34f-e1368336c34e req-0954e6c1-368c-4c43-931d-c62298071852 service nova] Acquiring lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updating instance_info_cache with network_info: [{"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Releasing lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Instance network_info: |[{"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-56d2f795-f600-40e2-b34f-e1368336c34e req-0954e6c1-368c-4c43-931d-c62298071852 service nova] Acquired lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-56d2f795-f600-40e2-b34f-e1368336c34e req-0954e6c1-368c-4c43-931d-c62298071852 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Refreshing network info cache for port f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-56d2f795-f600-40e2-b34f-e1368336c34e req-0954e6c1-368c-4c43-931d-c62298071852 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updated VIF entry in instance network info cache for port f1955c5d-ee34-4117-b651-daa2cc4b5002. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-56d2f795-f600-40e2-b34f-e1368336c34e req-0954e6c1-368c-4c43-931d-c62298071852 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updating instance_info_cache with network_info: [{"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:16:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-56d2f795-f600-40e2-b34f-e1368336c34e req-0954e6c1-368c-4c43-931d-c62298071852 service nova] Releasing lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:16:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG os_brick.utils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4949a0a4-b52a-4d57-8082-6e2dad4dd037]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[242377f0-6483-4fd3-b34b-5c147d79605f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc617c0-930c-4d11-8667-e80853941556]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7dc28c-f054-4ecb-be4a-8de914b99dfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:16:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:16:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:16:16 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:16:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c398b6e-d712-44e9-8e14-e4f65623c29e]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:16:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:16:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:16:16 user nova-compute[73012]: DEBUG os_brick.utils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:16:16 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updating existing volume attachment record: 7f2f81a2-dab4-4bdd-b5c1-a3ff3b68c720 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:16:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-9021e08f-c460-4e3c-9b21-93b2f2be6148 req-e2bc8ceb-74e3-4f04-9571-52621c5120de service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-changed-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-9021e08f-c460-4e3c-9b21-93b2f2be6148 req-e2bc8ceb-74e3-4f04-9571-52621c5120de service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Refreshing instance network info cache due to event network-changed-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:16:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9021e08f-c460-4e3c-9b21-93b2f2be6148 req-e2bc8ceb-74e3-4f04-9571-52621c5120de service nova] Acquiring lock "refresh_cache-634acb0d-490b-4b60-b4f3-947ee8e17457" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:16:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9021e08f-c460-4e3c-9b21-93b2f2be6148 req-e2bc8ceb-74e3-4f04-9571-52621c5120de service nova] Acquired lock "refresh_cache-634acb0d-490b-4b60-b4f3-947ee8e17457" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:16:20 user nova-compute[73012]: DEBUG nova.network.neutron [req-9021e08f-c460-4e3c-9b21-93b2f2be6148 req-e2bc8ceb-74e3-4f04-9571-52621c5120de service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Refreshing network info cache for port c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG nova.network.neutron [req-9021e08f-c460-4e3c-9b21-93b2f2be6148 req-e2bc8ceb-74e3-4f04-9571-52621c5120de service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Updated VIF entry in instance network info cache for port c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG nova.network.neutron [req-9021e08f-c460-4e3c-9b21-93b2f2be6148 req-e2bc8ceb-74e3-4f04-9571-52621c5120de service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Updating instance_info_cache with network_info: [{"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9021e08f-c460-4e3c-9b21-93b2f2be6148 req-e2bc8ceb-74e3-4f04-9571-52621c5120de service nova] Releasing lock "refresh_cache-634acb0d-490b-4b60-b4f3-947ee8e17457" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:16:21 user nova-compute[73012]: INFO nova.compute.manager [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Rebuilding instance
Aug 14 12:16:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lazy-loading 'trusted_certs' on Instance uuid 634acb0d-490b-4b60-b4f3-947ee8e17457 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lazy-loading 'pci_requests' on Instance uuid 634acb0d-490b-4b60-b4f3-947ee8e17457 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lazy-loading 'pci_devices' on Instance uuid 634acb0d-490b-4b60-b4f3-947ee8e17457 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lazy-loading 'resources' on Instance uuid 634acb0d-490b-4b60-b4f3-947ee8e17457 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lazy-loading 'migration_context' on Instance uuid 634acb0d-490b-4b60-b4f3-947ee8e17457 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73012) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:22 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance destroyed successfully.
Aug 14 12:16:22 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance destroyed successfully.
Aug 14 12:16:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-796497097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-967795420',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiv02NM7ly/GsobICpDT6xbGxQ/k8nXI2xD8KWTJ9NU7/1N/75H+g01HY/tgKIHkAjxMPMd5Bq1WB9THdIdhcSq+a2ng7zU/CwAUcMVT8u8+mSuR2gDPxvR8Awu4NKL/Q==',key_name='tempest-keypair-989125677',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='26d8edb773fa44bc847d02cac0a00483',ramdisk_id='',reservation_id='r-wetm1wbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-169217537',owner_user_name='tempest-ServerActionsV293TestJSON-169217537-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f6ace32c7b422ebe6f0d6f5d179988',uuid=634acb0d-490b-4b60-b4f3-947ee8e17457,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converting VIF {"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_vif [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0ece2ed-0a, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:16:22 user nova-compute[73012]: INFO os_vif [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a')
Aug 14 12:16:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSAcFGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:16:22 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2980e8ee-714b-403b-9b80-f1e25f1d0103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd8302e-d8d7-4661-a9be-14212f485849]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:16:22 user nova-compute[73012]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:16:22 user nova-compute[73012]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0122dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5d8a99-6f68-4776-a66e-f41ed173c308]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6cbe2a-7375-49a1-b288-628008738d85]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7af3c2c-9016-41d4-a483-58fdf8848c88]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0582a749-10cc-4e86-ab1e-b9be05abd5ce]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_68106b59', '/dev/disk/by-id/scsi-1SCST_BIO68106b59-d3d485566baacb38', '/dev/disk/by-id/scsi-26433643438353536') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[71279099-c7cd-4d8e-be10-330ab341129b]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[77617158-f1a3-4701-9c18-5c86dc74fda3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-unplugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] No waiting events found dispatching network-vif-unplugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:16:22 user nova-compute[73012]: WARNING nova.compute.manager [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received unexpected event network-vif-unplugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 for instance with vm_state active and task_state rebuilding.
Aug 14 12:16:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] No waiting events found dispatching network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:16:22 user nova-compute[73012]: WARNING nova.compute.manager [req-0fdb8ae6-406b-4b70-8971-eb8892086eeb req-59452d3a-ce69-442f-888b-ea2619a465e3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received unexpected event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 for instance with vm_state active and task_state rebuilding.
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.190s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc54ce4-e1d0-4f5d-9425-a96a3b28d046]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260]
Aug 14 12:16:23 user nova-compute[73012]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260] successful.
Aug 14 12:16:23 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.100s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5c7f8f-48df-407a-83e6-3cf95cba816f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.517s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] <== disconnect_volume: return (519ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:16:23 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Deleting instance files /opt/stack/data/nova/instances/634acb0d-490b-4b60-b4f3-947ee8e17457_del
Aug 14 12:16:23 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Deletion of /opt/stack/data/nova/instances/634acb0d-490b-4b60-b4f3-947ee8e17457_del complete
Aug 14 12:16:23 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 634acb0d-490b-4b60-b4f3-947ee8e17457 could not be found.
Aug 14 12:16:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSAcFGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:16:23 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1422a0-a2d6-4b6d-84cd-8079ee684092]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7ae1b2-517d-4543-ac6d-b0b6887ecdee]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:23 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:23 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0149cf0>, {}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Disconnecting from: [] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.059s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] <== disconnect_volume: return (60ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:16:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:16:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Preparing to wait for external event volume-reimaged-79f9156a-c066-4074-a84c-90e59b36fc38 {{(pid=73012) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 14 12:16:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:16:30 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Creating image(s)
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Ensure instance console log exists: /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Start _get_guest_xml network_info=[{"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxtUdajk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f831e0c-5249-461a-a00a-484c59da5a8a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3829322-cb1f-40f1-8ba0-8ab60eb116e9', 'serial': 'f3829322-cb1f-40f1-8ba0-8ab60eb116e9'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '7f2f81a2-dab4-4bdd-b5c1-a3ff3b68c720', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:16:30 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:16:30 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxtUdajk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:16:30 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:16:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:16:30 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:16:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:16:30 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df5865b-c667-4a9b-a49e-7fb11b64976c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:16:30 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c99ed3-9fdb-424d-ae23-9cc7195ab69e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9] added
Aug 14 12:16:30 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[71030c9c-e6f9-44b5-a06f-21e4a7553007]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d301cf51-9d1c-4609-95d9-24ff7c11c458]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxtUdajk {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxtUdajk" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d66feca-b290-4eb1-85e4-df833c735156]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxtUdajk'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fcba2c-46b7-4418-8202-63b1f8a37415]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e1d0f6-ba6d-4ef9-8fa6-bb7838acfdb4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:31 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:31 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff8a24e-7b68-446b-a7d1-78646db2b915]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9, portal: 172.16.0.220,3260]
Aug 14 12:16:31 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9, portal: 172.16.0.220,3260] successful.
Aug 14 12:16:31 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7457708-eba4-4e40-a8f1-3fcbee1601f3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d3ef3e-5c4c-49e6-9adb-80ec4706eb46]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:31 user nova-compute[73012]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:16:31 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:31 user nova-compute[73012]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:16:31 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e859b6e-ba02-4d28-af44-5886eb832c77]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:16:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxtUdajk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23938653963656330', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938653963656330', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-50514846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-50514846',id=26,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-9j75e963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:10Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=4f831e0c-5249-461a-a00a-484c59da5a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:51:79,bridge_name='br-int',has_traffic_filtering=True,id=f1955c5d-ee34-4117-b651-daa2cc4b5002,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1955c5d-ee') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:16:32 user nova-compute[73012]:   <uuid>4f831e0c-5249-461a-a00a-484c59da5a8a</uuid>
Aug 14 12:16:32 user nova-compute[73012]:   <name>instance-0000001a</name>
Aug 14 12:16:32 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:16:32 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:16:32 user nova-compute[73012]:   <metadata>
Aug 14 12:16:32 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:16:32 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:16:32 user nova-compute[73012]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-50514846</nova:name>
Aug 14 12:16:32 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:16:30</nova:creationTime>
Aug 14 12:16:32 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:16:32 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:16:32 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:16:32 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:16:32 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:16:32 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:16:32 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:16:32 user nova-compute[73012]:       <nova:owner>
Aug 14 12:16:32 user nova-compute[73012]:         <nova:user uuid="ae1ce3345617447486642ebe88c1621c">tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member</nova:user>
Aug 14 12:16:32 user nova-compute[73012]:         <nova:project uuid="6b1960abc96445f483386773f67d83e3">tempest-ServerBootFromVolumeStableRescueTest-1756944789</nova:project>
Aug 14 12:16:32 user nova-compute[73012]:       </nova:owner>
Aug 14 12:16:32 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:16:32 user nova-compute[73012]:       <nova:ports>
Aug 14 12:16:32 user nova-compute[73012]:         <nova:port uuid="f1955c5d-ee34-4117-b651-daa2cc4b5002">
Aug 14 12:16:32 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 12:16:32 user nova-compute[73012]:         </nova:port>
Aug 14 12:16:32 user nova-compute[73012]:       </nova:ports>
Aug 14 12:16:32 user nova-compute[73012]:     </nova:instance>
Aug 14 12:16:32 user nova-compute[73012]:   </metadata>
Aug 14 12:16:32 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:16:32 user nova-compute[73012]:     <system>
Aug 14 12:16:32 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:16:32 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:16:32 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:16:32 user nova-compute[73012]:       <entry name="serial">4f831e0c-5249-461a-a00a-484c59da5a8a</entry>
Aug 14 12:16:32 user nova-compute[73012]:       <entry name="uuid">4f831e0c-5249-461a-a00a-484c59da5a8a</entry>
Aug 14 12:16:32 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:16:32 user nova-compute[73012]:     </system>
Aug 14 12:16:32 user nova-compute[73012]:   </sysinfo>
Aug 14 12:16:32 user nova-compute[73012]:   <os>
Aug 14 12:16:32 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:16:32 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:16:32 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:16:32 user nova-compute[73012]:   </os>
Aug 14 12:16:32 user nova-compute[73012]:   <features>
Aug 14 12:16:32 user nova-compute[73012]:     <acpi/>
Aug 14 12:16:32 user nova-compute[73012]:     <apic/>
Aug 14 12:16:32 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:16:32 user nova-compute[73012]:   </features>
Aug 14 12:16:32 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:16:32 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:16:32 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:16:32 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:16:32 user nova-compute[73012]:   </clock>
Aug 14 12:16:32 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:16:32 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:16:32 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:16:32 user nova-compute[73012]:   </cpu>
Aug 14 12:16:32 user nova-compute[73012]:   <devices>
Aug 14 12:16:32 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:16:32 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:16:32 user nova-compute[73012]:       <source dev="/dev/sdb"/>
Aug 14 12:16:32 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:16:32 user nova-compute[73012]:       <serial>f3829322-cb1f-40f1-8ba0-8ab60eb116e9</serial>
Aug 14 12:16:32 user nova-compute[73012]:     </disk>
Aug 14 12:16:32 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:16:32 user nova-compute[73012]:       <mac address="fa:16:3e:47:51:79"/>
Aug 14 12:16:32 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:16:32 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:16:32 user nova-compute[73012]:       <target dev="tapf1955c5d-ee"/>
Aug 14 12:16:32 user nova-compute[73012]:     </interface>
Aug 14 12:16:32 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:16:32 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/console.log" append="off"/>
Aug 14 12:16:32 user nova-compute[73012]:     </serial>
Aug 14 12:16:32 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:16:32 user nova-compute[73012]:     <video>
Aug 14 12:16:32 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:16:32 user nova-compute[73012]:     </video>
Aug 14 12:16:32 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:16:32 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:16:32 user nova-compute[73012]:     </rng>
Aug 14 12:16:32 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:16:32 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:16:32 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:16:32 user nova-compute[73012]:     </memballoon>
Aug 14 12:16:32 user nova-compute[73012]:   </devices>
Aug 14 12:16:32 user nova-compute[73012]: </domain>
Aug 14 12:16:32 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-50514846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-50514846',id=26,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-9j75e963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:10Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=4f831e0c-5249-461a-a00a-484c59da5a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:51:79,bridge_name='br-int',has_traffic_filtering=True,id=f1955c5d-ee34-4117-b651-daa2cc4b5002,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1955c5d-ee') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG os_vif [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:51:79,bridge_name='br-int',has_traffic_filtering=True,id=f1955c5d-ee34-4117-b651-daa2cc4b5002,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1955c5d-ee') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1955c5d-ee, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1955c5d-ee, col_values=(('external_ids', {'iface-id': 'f1955c5d-ee34-4117-b651-daa2cc4b5002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:51:79', 'vm-uuid': '4f831e0c-5249-461a-a00a-484c59da5a8a'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:32 user nova-compute[73012]: INFO os_vif [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:51:79,bridge_name='br-int',has_traffic_filtering=True,id=f1955c5d-ee34-4117-b651-daa2cc4b5002,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1955c5d-ee')
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No VIF found with MAC fa:16:3e:47:51:79, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:16:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-e3c236e4-07de-490e-b591-bdab901538c8 req-26979ab8-320b-452c-a874-632504e4eb31 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e3c236e4-07de-490e-b591-bdab901538c8 req-26979ab8-320b-452c-a874-632504e4eb31 service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e3c236e4-07de-490e-b591-bdab901538c8 req-26979ab8-320b-452c-a874-632504e4eb31 service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e3c236e4-07de-490e-b591-bdab901538c8 req-26979ab8-320b-452c-a874-632504e4eb31 service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-e3c236e4-07de-490e-b591-bdab901538c8 req-26979ab8-320b-452c-a874-632504e4eb31 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:16:34 user nova-compute[73012]: WARNING nova.compute.manager [req-e3c236e4-07de-490e-b591-bdab901538c8 req-26979ab8-320b-452c-a874-632504e4eb31 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state building and task_state spawning.
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015395.9369776, 4f831e0c-5249-461a-a00a-484c59da5a8a => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:16:35 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] VM Resumed (Lifecycle Event)
Aug 14 12:16:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:16:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:16:36 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Instance spawned successfully.
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:16:36 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015395.9378967, 4f831e0c-5249-461a-a00a-484c59da5a8a => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:16:36 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] VM Started (Lifecycle Event)
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-08f5fb4a-9462-42ce-8bb6-4e58b24fe941 req-6a03fb1b-7474-434a-a766-a969c3e5e07f service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-08f5fb4a-9462-42ce-8bb6-4e58b24fe941 req-6a03fb1b-7474-434a-a766-a969c3e5e07f service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-08f5fb4a-9462-42ce-8bb6-4e58b24fe941 req-6a03fb1b-7474-434a-a766-a969c3e5e07f service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-08f5fb4a-9462-42ce-8bb6-4e58b24fe941 req-6a03fb1b-7474-434a-a766-a969c3e5e07f service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-08f5fb4a-9462-42ce-8bb6-4e58b24fe941 req-6a03fb1b-7474-434a-a766-a969c3e5e07f service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:16:36 user nova-compute[73012]: WARNING nova.compute.manager [req-08f5fb4a-9462-42ce-8bb6-4e58b24fe941 req-6a03fb1b-7474-434a-a766-a969c3e5e07f service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state building and task_state spawning.
Aug 14 12:16:36 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:16:36 user nova-compute[73012]: INFO nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 14 12:16:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:36 user nova-compute[73012]: INFO nova.compute.manager [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Took 26.51 seconds to build instance.
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d7d97129-c191-4c07-934b-eb06be045721 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.652s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015382.5031857, 634acb0d-490b-4b60-b4f3-947ee8e17457 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:16:37 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] VM Stopped (Lifecycle Event)
Aug 14 12:16:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-469bcb8f-1fda-4d48-8383-50fe873c377a None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:16:38 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:16:38 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7749MB free_disk=25.506759643554688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 634acb0d-490b-4b60-b4f3-947ee8e17457 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:16:38 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:16:39 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:16:39 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:16:39 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:16:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.815s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:39 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:16:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:16:39 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:16:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:16:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:16:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:16:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-a508815f-5b13-4abc-bcd3-26e388a1d149 req-54817903-6d22-4a8a-825e-cf770a4d1503 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event volume-reimaged-79f9156a-c066-4074-a84c-90e59b36fc38 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a508815f-5b13-4abc-bcd3-26e388a1d149 req-54817903-6d22-4a8a-825e-cf770a4d1503 service nova] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a508815f-5b13-4abc-bcd3-26e388a1d149 req-54817903-6d22-4a8a-825e-cf770a4d1503 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a508815f-5b13-4abc-bcd3-26e388a1d149 req-54817903-6d22-4a8a-825e-cf770a4d1503 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-a508815f-5b13-4abc-bcd3-26e388a1d149 req-54817903-6d22-4a8a-825e-cf770a4d1503 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Processing event volume-reimaged-79f9156a-c066-4074-a84c-90e59b36fc38 {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:16:45 user nova-compute[73012]: INFO nova.virt.block_device [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Booting with volume 79f9156a-c066-4074-a84c-90e59b36fc38 at /dev/vda
Aug 14 12:16:45 user nova-compute[73012]: DEBUG os_brick.utils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0024f24-b3c4-4b33-84ba-5e7d09a64345]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e0479c-ee79-4c01-a5ee-93f450b38a5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[69224a07-66e4-4fe6-b515-1e5f0f18b14b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ad2029-b78b-4470-817f-3d3122763db6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:16:45 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:16:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbb4672-448b-459d-9345-79c65a3b5560]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG os_brick.utils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:16:45 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Updating existing volume attachment record: 3072380d-25d1-41d7-b37a-d8ee3463f04e {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:16:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:48 user nova-compute[73012]: INFO nova.compute.manager [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Unshelving
Aug 14 12:16:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:48 user nova-compute[73012]: DEBUG nova.objects.instance [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'pci_requests' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:48 user nova-compute[73012]: DEBUG nova.objects.instance [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'numa_topology' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:48 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:16:48 user nova-compute[73012]: INFO nova.compute.claims [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Claim successful on node user
Aug 14 12:16:48 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:16:48 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:16:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:48 user nova-compute[73012]: INFO nova.network.neutron [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating port c652878c-a896-4c3f-8108-ec1157747dd8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 12:16:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:16:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquired lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:16:49 user nova-compute[73012]: DEBUG nova.network.neutron [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:16:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-24505923-49d1-4601-a95c-d358c09f2bb0 req-11f1be27-afdd-4a75-944f-1d4e2df911ff service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-changed-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:16:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-24505923-49d1-4601-a95c-d358c09f2bb0 req-11f1be27-afdd-4a75-944f-1d4e2df911ff service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Refreshing instance network info cache due to event network-changed-c652878c-a896-4c3f-8108-ec1157747dd8. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:16:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-24505923-49d1-4601-a95c-d358c09f2bb0 req-11f1be27-afdd-4a75-944f-1d4e2df911ff service nova] Acquiring lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating instance_info_cache with network_info: [{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Releasing lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:16:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Creating image(s)
Aug 14 12:16:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG nova.objects.instance [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'trusted_certs' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-24505923-49d1-4601-a95c-d358c09f2bb0 req-11f1be27-afdd-4a75-944f-1d4e2df911ff service nova] Acquired lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-24505923-49d1-4601-a95c-d358c09f2bb0 req-11f1be27-afdd-4a75-944f-1d4e2df911ff service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Refreshing network info cache for port c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "55417786b8b2c01e0bcecf9ff26f783d31cf09bd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "55417786b8b2c01e0bcecf9ff26f783d31cf09bd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.012s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd.part --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:51 user nova-compute[73012]: DEBUG nova.virt.images [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] 8d9c1944-34ea-4357-86ba-3d85fdbfea52 was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:16:51 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:16:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd.part /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG nova.network.neutron [req-24505923-49d1-4601-a95c-d358c09f2bb0 req-11f1be27-afdd-4a75-944f-1d4e2df911ff service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updated VIF entry in instance network info cache for port c652878c-a896-4c3f-8108-ec1157747dd8. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG nova.network.neutron [req-24505923-49d1-4601-a95c-d358c09f2bb0 req-11f1be27-afdd-4a75-944f-1d4e2df911ff service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating instance_info_cache with network_info: [{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-24505923-49d1-4601-a95c-d358c09f2bb0 req-11f1be27-afdd-4a75-944f-1d4e2df911ff service nova] Releasing lock "refresh_cache-cfa2f996-7907-4490-84d6-c04c5d0ca6e5" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd.part /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd.converted" returned: 0 in 0.380s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "55417786b8b2c01e0bcecf9ff26f783d31cf09bd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.941s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "55417786b8b2c01e0bcecf9ff26f783d31cf09bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "55417786b8b2c01e0bcecf9ff26f783d31cf09bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd,backing_fmt=raw /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd,backing_fmt=raw /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk 1073741824" returned: 0 in 0.068s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "55417786b8b2c01e0bcecf9ff26f783d31cf09bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd --force-share --output=json" returned: 0 in 0.194s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:53 user nova-compute[73012]: DEBUG nova.objects.instance [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'migration_context' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:53 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Rebasing disk image.
Aug 14 12:16:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 -F raw /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:16:54 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Creating image(s)
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Ensure instance console log exists: /opt/stack/data/nova/instances/634acb0d-490b-4b60-b4f3-947ee8e17457/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Start _get_guest_xml network_info=[{"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSAcFGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '634acb0d-490b-4b60-b4f3-947ee8e17457', 'attached_at': '', 'detached_at': '', 'volume_id': '79f9156a-c066-4074-a84c-90e59b36fc38', 'serial': '79f9156a-c066-4074-a84c-90e59b36fc38'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '3072380d-25d1-41d7-b37a-d8ee3463f04e', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:16:54 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 12:16:54 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lazy-loading 'vcpu_model' on Instance uuid 634acb0d-490b-4b60-b4f3-947ee8e17457 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSAcFGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:16:54 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:16:54 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:16:54 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[561f709d-7a2c-4e98-834a-9aa25c760bb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:16:54 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f906cf0-9ca6-405c-b9ed-7ddac4241aff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38] added
Aug 14 12:16:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.053s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd2a373-ebdf-48a7-8572-c82e58c304ab]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5810acc1-de0c-4bb2-b1e2-ec58d55a86f6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHSAcFGz {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHSAcFGz" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bb9caa-2ce9-4a1e-9d90-a35e9e4bcdf4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NHSAcFGz'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a31bd34-86c1-4ae9-ae8f-9cc43f3833a0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae1747c-ff29-4ff6-9690-5a924a993782]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:54 user nova-compute[73012]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:16:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:54 user nova-compute[73012]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:16:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:16:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd13379-0390-40bd-bc9a-c8435223ef6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260]
Aug 14 12:16:55 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260] successful.
Aug 14 12:16:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2e8089-f867-4f3d-b387-6a7df0038ee1]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf64b46-29e7-4e3c-a66a-7c9c1641ff58]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:55 user nova-compute[73012]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:16:55 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:16:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:16:55 user nova-compute[73012]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:16:55 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:16:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b90aa7-f5ee-4f4b-a1a9-dc6a4191be4e]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSAcFGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 -F raw /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk" returned: 0 in 2.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Ensure instance console log exists: /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Start _get_guest_xml network_info=[{"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='766356cd41aa121b4d680e27cb8bbfb0',container_format='bare',created_at=2023-08-14T12:14:55Z,direct_url=<?>,disk_format='qcow2',id=8d9c1944-34ea-4357-86ba-3d85fdbfea52,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-838748235-shelved',owner='b522100e4bf447e3b544983c451c3786',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T12:15:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:16:55 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:16:55 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='766356cd41aa121b4d680e27cb8bbfb0',container_format='bare',created_at=2023-08-14T12:14:55Z,direct_url=<?>,disk_format='qcow2',id=8d9c1944-34ea-4357-86ba-3d85fdbfea52,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-838748235-shelved',owner='b522100e4bf447e3b544983c451c3786',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T12:15:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.objects.instance [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'vcpu_model' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-838748235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-838748235',id=22,image_ref='8d9c1944-34ea-4357-86ba-3d85fdbfea52',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-859094030',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:13:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-f2gn3cvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member',shelved_at='2023-08-14T12:15:00.602120',shelved_host='user',shelved_image_id='8d9c1944-34ea-4357-86ba-3d85fdbfea52'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=cfa2f996-7907-4490-84d6-c04c5d0ca6e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.objects.instance [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'pci_devices' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:16:55 user nova-compute[73012]:   <uuid>cfa2f996-7907-4490-84d6-c04c5d0ca6e5</uuid>
Aug 14 12:16:55 user nova-compute[73012]:   <name>instance-00000016</name>
Aug 14 12:16:55 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:16:55 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:16:55 user nova-compute[73012]:   <metadata>
Aug 14 12:16:55 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:16:55 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:16:55 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-838748235</nova:name>
Aug 14 12:16:55 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:16:55</nova:creationTime>
Aug 14 12:16:55 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:16:55 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:16:55 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:16:55 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:16:55 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:16:55 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:16:55 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:16:55 user nova-compute[73012]:       <nova:owner>
Aug 14 12:16:55 user nova-compute[73012]:         <nova:user uuid="7648caa38d8e4de6bf9751a512ffb14a">tempest-AttachVolumeShelveTestJSON-192114773-project-member</nova:user>
Aug 14 12:16:55 user nova-compute[73012]:         <nova:project uuid="b522100e4bf447e3b544983c451c3786">tempest-AttachVolumeShelveTestJSON-192114773</nova:project>
Aug 14 12:16:55 user nova-compute[73012]:       </nova:owner>
Aug 14 12:16:55 user nova-compute[73012]:       <nova:root type="image" uuid="8d9c1944-34ea-4357-86ba-3d85fdbfea52"/>
Aug 14 12:16:55 user nova-compute[73012]:       <nova:ports>
Aug 14 12:16:55 user nova-compute[73012]:         <nova:port uuid="c652878c-a896-4c3f-8108-ec1157747dd8">
Aug 14 12:16:55 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:16:55 user nova-compute[73012]:         </nova:port>
Aug 14 12:16:55 user nova-compute[73012]:       </nova:ports>
Aug 14 12:16:55 user nova-compute[73012]:     </nova:instance>
Aug 14 12:16:55 user nova-compute[73012]:   </metadata>
Aug 14 12:16:55 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:16:55 user nova-compute[73012]:     <system>
Aug 14 12:16:55 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:16:55 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:16:55 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:16:55 user nova-compute[73012]:       <entry name="serial">cfa2f996-7907-4490-84d6-c04c5d0ca6e5</entry>
Aug 14 12:16:55 user nova-compute[73012]:       <entry name="uuid">cfa2f996-7907-4490-84d6-c04c5d0ca6e5</entry>
Aug 14 12:16:55 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:16:55 user nova-compute[73012]:     </system>
Aug 14 12:16:55 user nova-compute[73012]:   </sysinfo>
Aug 14 12:16:55 user nova-compute[73012]:   <os>
Aug 14 12:16:55 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:16:55 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:16:55 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:16:55 user nova-compute[73012]:   </os>
Aug 14 12:16:55 user nova-compute[73012]:   <features>
Aug 14 12:16:55 user nova-compute[73012]:     <acpi/>
Aug 14 12:16:55 user nova-compute[73012]:     <apic/>
Aug 14 12:16:55 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:16:55 user nova-compute[73012]:   </features>
Aug 14 12:16:55 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:16:55 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:16:55 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:16:55 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:16:55 user nova-compute[73012]:   </clock>
Aug 14 12:16:55 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:16:55 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:16:55 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:16:55 user nova-compute[73012]:   </cpu>
Aug 14 12:16:55 user nova-compute[73012]:   <devices>
Aug 14 12:16:55 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:16:55 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:16:55 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk"/>
Aug 14 12:16:55 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:16:55 user nova-compute[73012]:     </disk>
Aug 14 12:16:55 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:16:55 user nova-compute[73012]:       <mac address="fa:16:3e:8d:6f:90"/>
Aug 14 12:16:55 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:16:55 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:16:55 user nova-compute[73012]:       <target dev="tapc652878c-a8"/>
Aug 14 12:16:55 user nova-compute[73012]:     </interface>
Aug 14 12:16:55 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:16:55 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/console.log" append="off"/>
Aug 14 12:16:55 user nova-compute[73012]:     </serial>
Aug 14 12:16:55 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:16:55 user nova-compute[73012]:     <video>
Aug 14 12:16:55 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:16:55 user nova-compute[73012]:     </video>
Aug 14 12:16:55 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:16:55 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:16:55 user nova-compute[73012]:     </rng>
Aug 14 12:16:55 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:16:55 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:16:55 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:16:55 user nova-compute[73012]:     </memballoon>
Aug 14 12:16:55 user nova-compute[73012]:   </devices>
Aug 14 12:16:55 user nova-compute[73012]: </domain>
Aug 14 12:16:55 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-838748235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-838748235',id=22,image_ref='8d9c1944-34ea-4357-86ba-3d85fdbfea52',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-859094030',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:13:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-f2gn3cvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member',shelved_at='2023-08-14T12:15:00.602120',shelved_host='user',shelved_image_id='8d9c1944-34ea-4357-86ba-3d85fdbfea52'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=cfa2f996-7907-4490-84d6-c04c5d0ca6e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG os_vif [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc652878c-a8, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc652878c-a8, col_values=(('external_ids', {'iface-id': 'c652878c-a896-4c3f-8108-ec1157747dd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:6f:90', 'vm-uuid': 'cfa2f996-7907-4490-84d6-c04c5d0ca6e5'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:55 user nova-compute[73012]: INFO os_vif [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8')
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:16:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] No VIF found with MAC fa:16:3e:8d:6f:90, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26433643438353536', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433643438353536', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-796497097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-967795420',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiv02NM7ly/GsobICpDT6xbGxQ/k8nXI2xD8KWTJ9NU7/1N/75H+g01HY/tgKIHkAjxMPMd5Bq1WB9THdIdhcSq+a2ng7zU/CwAUcMVT8u8+mSuR2gDPxvR8Awu4NKL/Q==',key_name='tempest-keypair-989125677',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='26d8edb773fa44bc847d02cac0a00483',ramdisk_id='',reservation_id='r-wetm1wbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-169217537',owner_user_name='tempest-ServerActionsV293TestJSON-169217537-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f6ace32c7b422ebe6f0d6f5d179988',uuid=634acb0d-490b-4b60-b4f3-947ee8e17457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converting VIF {"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:16:56 user nova-compute[73012]:   <uuid>634acb0d-490b-4b60-b4f3-947ee8e17457</uuid>
Aug 14 12:16:56 user nova-compute[73012]:   <name>instance-00000018</name>
Aug 14 12:16:56 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:16:56 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:16:56 user nova-compute[73012]:   <metadata>
Aug 14 12:16:56 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:16:56 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:16:56 user nova-compute[73012]:       <nova:name>tempest-ServerActionsV293TestJSON-server-796497097</nova:name>
Aug 14 12:16:56 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:16:54</nova:creationTime>
Aug 14 12:16:56 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:16:56 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:16:56 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:16:56 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:16:56 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:16:56 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:16:56 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:16:56 user nova-compute[73012]:       <nova:owner>
Aug 14 12:16:56 user nova-compute[73012]:         <nova:user uuid="d5f6ace32c7b422ebe6f0d6f5d179988">tempest-ServerActionsV293TestJSON-169217537-project-member</nova:user>
Aug 14 12:16:56 user nova-compute[73012]:         <nova:project uuid="26d8edb773fa44bc847d02cac0a00483">tempest-ServerActionsV293TestJSON-169217537</nova:project>
Aug 14 12:16:56 user nova-compute[73012]:       </nova:owner>
Aug 14 12:16:56 user nova-compute[73012]:       <nova:ports>
Aug 14 12:16:56 user nova-compute[73012]:         <nova:port uuid="c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860">
Aug 14 12:16:56 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 12:16:56 user nova-compute[73012]:         </nova:port>
Aug 14 12:16:56 user nova-compute[73012]:       </nova:ports>
Aug 14 12:16:56 user nova-compute[73012]:     </nova:instance>
Aug 14 12:16:56 user nova-compute[73012]:   </metadata>
Aug 14 12:16:56 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:16:56 user nova-compute[73012]:     <system>
Aug 14 12:16:56 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:16:56 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:16:56 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:16:56 user nova-compute[73012]:       <entry name="serial">634acb0d-490b-4b60-b4f3-947ee8e17457</entry>
Aug 14 12:16:56 user nova-compute[73012]:       <entry name="uuid">634acb0d-490b-4b60-b4f3-947ee8e17457</entry>
Aug 14 12:16:56 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:16:56 user nova-compute[73012]:     </system>
Aug 14 12:16:56 user nova-compute[73012]:   </sysinfo>
Aug 14 12:16:56 user nova-compute[73012]:   <os>
Aug 14 12:16:56 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:16:56 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:16:56 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:16:56 user nova-compute[73012]:   </os>
Aug 14 12:16:56 user nova-compute[73012]:   <features>
Aug 14 12:16:56 user nova-compute[73012]:     <acpi/>
Aug 14 12:16:56 user nova-compute[73012]:     <apic/>
Aug 14 12:16:56 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:16:56 user nova-compute[73012]:   </features>
Aug 14 12:16:56 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:16:56 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:16:56 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:16:56 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:16:56 user nova-compute[73012]:   </clock>
Aug 14 12:16:56 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:16:56 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:16:56 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:16:56 user nova-compute[73012]:   </cpu>
Aug 14 12:16:56 user nova-compute[73012]:   <devices>
Aug 14 12:16:56 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:16:56 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:16:56 user nova-compute[73012]:       <source dev="/dev/sdd"/>
Aug 14 12:16:56 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:16:56 user nova-compute[73012]:       <serial>79f9156a-c066-4074-a84c-90e59b36fc38</serial>
Aug 14 12:16:56 user nova-compute[73012]:     </disk>
Aug 14 12:16:56 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:16:56 user nova-compute[73012]:       <mac address="fa:16:3e:ec:ab:72"/>
Aug 14 12:16:56 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:16:56 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:16:56 user nova-compute[73012]:       <target dev="tapc0ece2ed-0a"/>
Aug 14 12:16:56 user nova-compute[73012]:     </interface>
Aug 14 12:16:56 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:16:56 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/634acb0d-490b-4b60-b4f3-947ee8e17457/console.log" append="off"/>
Aug 14 12:16:56 user nova-compute[73012]:     </serial>
Aug 14 12:16:56 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:16:56 user nova-compute[73012]:     <video>
Aug 14 12:16:56 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:16:56 user nova-compute[73012]:     </video>
Aug 14 12:16:56 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:16:56 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:16:56 user nova-compute[73012]:     </rng>
Aug 14 12:16:56 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:16:56 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:16:56 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:16:56 user nova-compute[73012]:     </memballoon>
Aug 14 12:16:56 user nova-compute[73012]:   </devices>
Aug 14 12:16:56 user nova-compute[73012]: </domain>
Aug 14 12:16:56 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-796497097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-967795420',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiv02NM7ly/GsobICpDT6xbGxQ/k8nXI2xD8KWTJ9NU7/1N/75H+g01HY/tgKIHkAjxMPMd5Bq1WB9THdIdhcSq+a2ng7zU/CwAUcMVT8u8+mSuR2gDPxvR8Awu4NKL/Q==',key_name='tempest-keypair-989125677',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='26d8edb773fa44bc847d02cac0a00483',ramdisk_id='',reservation_id='r-wetm1wbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-169217537',owner_user_name='tempest-ServerActionsV293TestJSON-169217537-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f6ace32c7b422ebe6f0d6f5d179988',uuid=634acb0d-490b-4b60-b4f3-947ee8e17457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converting VIF {"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG os_vif [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0ece2ed-0a, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0ece2ed-0a, col_values=(('external_ids', {'iface-id': 'c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:ab:72', 'vm-uuid': '634acb0d-490b-4b60-b4f3-947ee8e17457'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:56 user nova-compute[73012]: INFO os_vif [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a')
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:16:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] No VIF found with MAC fa:16:3e:ec:ab:72, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:16:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:16:58 user nova-compute[73012]: INFO nova.compute.claims [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Claim successful on node user
Aug 14 12:16:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:16:58 user nova-compute[73012]: DEBUG nova.network.neutron [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:16:58 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:16:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG nova.policy [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f89f51cc15e4ffb8860f42ddcb44ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3be304f15a542fc98ed7614001dd016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:16:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Creating image(s)
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "/opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "/opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "/opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "67ec011e146d1a61ed0b90b73450546f44089b34" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "67ec011e146d1a61ed0b90b73450546f44089b34" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34.part --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG nova.virt.images [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] a251c3cc-bd85-4597-9c67-c0b98d2f6b2f was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34.part /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34.part /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34.converted" returned: 0 in 0.221s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:16:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Successfully created port: e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "67ec011e146d1a61ed0b90b73450546f44089b34" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.015s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34 --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "67ec011e146d1a61ed0b90b73450546f44089b34" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "67ec011e146d1a61ed0b90b73450546f44089b34" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-6c8dda0c-0405-46f2-8ae9-34ef39b2b9c0 req-ecd773f1-cec7-476d-895b-f7c89b71e44e service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6c8dda0c-0405-46f2-8ae9-34ef39b2b9c0 req-ecd773f1-cec7-476d-895b-f7c89b71e44e service nova] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6c8dda0c-0405-46f2-8ae9-34ef39b2b9c0 req-ecd773f1-cec7-476d-895b-f7c89b71e44e service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6c8dda0c-0405-46f2-8ae9-34ef39b2b9c0 req-ecd773f1-cec7-476d-895b-f7c89b71e44e service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-6c8dda0c-0405-46f2-8ae9-34ef39b2b9c0 req-ecd773f1-cec7-476d-895b-f7c89b71e44e service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] No waiting events found dispatching network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:17:00 user nova-compute[73012]: WARNING nova.compute.manager [req-6c8dda0c-0405-46f2-8ae9-34ef39b2b9c0 req-ecd773f1-cec7-476d-895b-f7c89b71e44e service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received unexpected event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 12:17:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34 --force-share --output=json" returned: 0 in 0.194s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34,backing_fmt=raw /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34,backing_fmt=raw /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk 1073741824" returned: 0 in 0.065s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "67ec011e146d1a61ed0b90b73450546f44089b34" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34 --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015420.8369555, 634acb0d-490b-4b60-b4f3-947ee8e17457 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:17:00 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] VM Resumed (Lifecycle Event)
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:17:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance spawned successfully.
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:17:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance spawned successfully.
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:00 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015420.8539677, 634acb0d-490b-4b60-b4f3-947ee8e17457 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:17:00 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] VM Started (Lifecycle Event)
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Cannot resize image /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'migration_context' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:17:00 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 12:17:00 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015420.8614655, cfa2f996-7907-4490-84d6-c04c5d0ca6e5 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:17:00 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] VM Resumed (Lifecycle Event)
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Ensure instance console log exists: /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:17:01 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015420.8622274, cfa2f996-7907-4490-84d6-c04c5d0ca6e5 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:17:01 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] VM Started (Lifecycle Event)
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Successfully updated port: e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquired lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-f8c94424-26fd-4d29-92b8-752fbcf6b63f req-eb842a0d-3bf9-4b45-9c34-60c8c4763e52 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-f8c94424-26fd-4d29-92b8-752fbcf6b63f req-eb842a0d-3bf9-4b45-9c34-60c8c4763e52 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing instance network info cache due to event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f8c94424-26fd-4d29-92b8-752fbcf6b63f req-eb842a0d-3bf9-4b45-9c34-60c8c4763e52 service nova] Acquiring lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73012) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 12:17:01 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a508815f-5b13-4abc-bcd3-26e388a1d149 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-866cf1e6-b750-4ced-b790-356538e2407c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.083s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updating instance_info_cache with network_info: [{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Releasing lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Instance network_info: |[{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f8c94424-26fd-4d29-92b8-752fbcf6b63f req-eb842a0d-3bf9-4b45-9c34-60c8c4763e52 service nova] Acquired lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-f8c94424-26fd-4d29-92b8-752fbcf6b63f req-eb842a0d-3bf9-4b45-9c34-60c8c4763e52 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Start _get_guest_xml network_info=[{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:16:55Z,direct_url=<?>,disk_format='qcow2',id=a251c3cc-bd85-4597-9c67-c0b98d2f6b2f,min_disk=0,min_ram=0,name='tempest-scenario-img--14325321',owner='b3be304f15a542fc98ed7614001dd016',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:16:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'a251c3cc-bd85-4597-9c67-c0b98d2f6b2f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:17:01 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:17:01 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:16:55Z,direct_url=<?>,disk_format='qcow2',id=a251c3cc-bd85-4597-9c67-c0b98d2f6b2f,min_disk=0,min_ram=0,name='tempest-scenario-img--14325321',owner='b3be304f15a542fc98ed7614001dd016',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:16:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2090819762',display_name='tempest-TestMinimumBasicScenario-server-2090819762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2090819762',id=27,image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/1P1r7AreTvEXXZhLTnEfr4e7XilrWGHn6/JEAVreeRFnynkXIX9PgsUZ+6qb9djMhPUPTX1LoegbIFijSORdeYf9w55P6fR3mWAuq6XBGe8VbYr5eZI8r1npC31ylAA==',key_name='tempest-TestMinimumBasicScenario-884270579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3be304f15a542fc98ed7614001dd016',ramdisk_id='',reservation_id='r-brsox2q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1379939828',owner_user_name='tempest-TestMinimumBasicScenario-1379939828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:59Z,user_data=None,user_id='0f89f51cc15e4ffb8860f42ddcb44ae1',uuid=722de834-9535-4249-91b3-378e4b98f8e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converting VIF {"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'pci_devices' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:17:01 user nova-compute[73012]:   <uuid>722de834-9535-4249-91b3-378e4b98f8e0</uuid>
Aug 14 12:17:01 user nova-compute[73012]:   <name>instance-0000001b</name>
Aug 14 12:17:01 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:17:01 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:17:01 user nova-compute[73012]:   <metadata>
Aug 14 12:17:01 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:17:01 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:17:01 user nova-compute[73012]:       <nova:name>tempest-TestMinimumBasicScenario-server-2090819762</nova:name>
Aug 14 12:17:01 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:17:01</nova:creationTime>
Aug 14 12:17:01 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:17:01 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:17:01 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:17:01 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:17:01 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:17:01 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:17:01 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:17:01 user nova-compute[73012]:       <nova:owner>
Aug 14 12:17:01 user nova-compute[73012]:         <nova:user uuid="0f89f51cc15e4ffb8860f42ddcb44ae1">tempest-TestMinimumBasicScenario-1379939828-project-member</nova:user>
Aug 14 12:17:01 user nova-compute[73012]:         <nova:project uuid="b3be304f15a542fc98ed7614001dd016">tempest-TestMinimumBasicScenario-1379939828</nova:project>
Aug 14 12:17:01 user nova-compute[73012]:       </nova:owner>
Aug 14 12:17:01 user nova-compute[73012]:       <nova:root type="image" uuid="a251c3cc-bd85-4597-9c67-c0b98d2f6b2f"/>
Aug 14 12:17:01 user nova-compute[73012]:       <nova:ports>
Aug 14 12:17:01 user nova-compute[73012]:         <nova:port uuid="e0ba563f-c8ca-48c4-8954-be7f64edde26">
Aug 14 12:17:01 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 12:17:01 user nova-compute[73012]:         </nova:port>
Aug 14 12:17:01 user nova-compute[73012]:       </nova:ports>
Aug 14 12:17:01 user nova-compute[73012]:     </nova:instance>
Aug 14 12:17:01 user nova-compute[73012]:   </metadata>
Aug 14 12:17:01 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:17:01 user nova-compute[73012]:     <system>
Aug 14 12:17:01 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:17:01 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:17:01 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:17:01 user nova-compute[73012]:       <entry name="serial">722de834-9535-4249-91b3-378e4b98f8e0</entry>
Aug 14 12:17:01 user nova-compute[73012]:       <entry name="uuid">722de834-9535-4249-91b3-378e4b98f8e0</entry>
Aug 14 12:17:01 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:17:01 user nova-compute[73012]:     </system>
Aug 14 12:17:01 user nova-compute[73012]:   </sysinfo>
Aug 14 12:17:01 user nova-compute[73012]:   <os>
Aug 14 12:17:01 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:17:01 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:17:01 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:17:01 user nova-compute[73012]:   </os>
Aug 14 12:17:01 user nova-compute[73012]:   <features>
Aug 14 12:17:01 user nova-compute[73012]:     <acpi/>
Aug 14 12:17:01 user nova-compute[73012]:     <apic/>
Aug 14 12:17:01 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:17:01 user nova-compute[73012]:   </features>
Aug 14 12:17:01 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:17:01 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:17:01 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:17:01 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:17:01 user nova-compute[73012]:   </clock>
Aug 14 12:17:01 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:17:01 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:17:01 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:17:01 user nova-compute[73012]:   </cpu>
Aug 14 12:17:01 user nova-compute[73012]:   <devices>
Aug 14 12:17:01 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:17:01 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:17:01 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk"/>
Aug 14 12:17:01 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:17:01 user nova-compute[73012]:     </disk>
Aug 14 12:17:01 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:17:01 user nova-compute[73012]:       <mac address="fa:16:3e:be:2f:08"/>
Aug 14 12:17:01 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:17:01 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:17:01 user nova-compute[73012]:       <target dev="tape0ba563f-c8"/>
Aug 14 12:17:01 user nova-compute[73012]:     </interface>
Aug 14 12:17:01 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:17:01 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/console.log" append="off"/>
Aug 14 12:17:01 user nova-compute[73012]:     </serial>
Aug 14 12:17:01 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:17:01 user nova-compute[73012]:     <video>
Aug 14 12:17:01 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:17:01 user nova-compute[73012]:     </video>
Aug 14 12:17:01 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:17:01 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:17:01 user nova-compute[73012]:     </rng>
Aug 14 12:17:01 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:17:01 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:17:01 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:17:01 user nova-compute[73012]:     </memballoon>
Aug 14 12:17:01 user nova-compute[73012]:   </devices>
Aug 14 12:17:01 user nova-compute[73012]: </domain>
Aug 14 12:17:01 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2090819762',display_name='tempest-TestMinimumBasicScenario-server-2090819762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2090819762',id=27,image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/1P1r7AreTvEXXZhLTnEfr4e7XilrWGHn6/JEAVreeRFnynkXIX9PgsUZ+6qb9djMhPUPTX1LoegbIFijSORdeYf9w55P6fR3mWAuq6XBGe8VbYr5eZI8r1npC31ylAA==',key_name='tempest-TestMinimumBasicScenario-884270579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3be304f15a542fc98ed7614001dd016',ramdisk_id='',reservation_id='r-brsox2q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1379939828',owner_user_name='tempest-TestMinimumBasicScenario-1379939828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:59Z,user_data=None,user_id='0f89f51cc15e4ffb8860f42ddcb44ae1',uuid=722de834-9535-4249-91b3-378e4b98f8e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converting VIF {"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG os_vif [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0ba563f-c8, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0ba563f-c8, col_values=(('external_ids', {'iface-id': 'e0ba563f-c8ca-48c4-8954-be7f64edde26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:2f:08', 'vm-uuid': '722de834-9535-4249-91b3-378e4b98f8e0'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:01 user nova-compute[73012]: INFO os_vif [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8')
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:17:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No VIF found with MAC fa:16:3e:be:2f:08, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-f8c94424-26fd-4d29-92b8-752fbcf6b63f req-eb842a0d-3bf9-4b45-9c34-60c8c4763e52 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updated VIF entry in instance network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-f8c94424-26fd-4d29-92b8-752fbcf6b63f req-eb842a0d-3bf9-4b45-9c34-60c8c4763e52 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updating instance_info_cache with network_info: [{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f8c94424-26fd-4d29-92b8-752fbcf6b63f req-eb842a0d-3bf9-4b45-9c34-60c8c4763e52 service nova] Releasing lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] No waiting events found dispatching network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:17:02 user nova-compute[73012]: WARNING nova.compute.manager [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received unexpected event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 for instance with vm_state active and task_state None.
Aug 14 12:17:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] No waiting events found dispatching network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:17:02 user nova-compute[73012]: WARNING nova.compute.manager [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received unexpected event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 for instance with vm_state active and task_state None.
Aug 14 12:17:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] No waiting events found dispatching network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:17:02 user nova-compute[73012]: WARNING nova.compute.manager [req-d864de42-17c4-4f07-a9a2-6dca4042e80e req-24795b28-61ed-47bb-a161-c750ed748ca3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received unexpected event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 for instance with vm_state active and task_state None.
Aug 14 12:17:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-d9b68ca2-a7ec-4275-a230-0e4d54e90ff7 req-6afd2068-ec17-4e33-be61-d87b271d7592 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d9b68ca2-a7ec-4275-a230-0e4d54e90ff7 req-6afd2068-ec17-4e33-be61-d87b271d7592 service nova] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d9b68ca2-a7ec-4275-a230-0e4d54e90ff7 req-6afd2068-ec17-4e33-be61-d87b271d7592 service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d9b68ca2-a7ec-4275-a230-0e4d54e90ff7 req-6afd2068-ec17-4e33-be61-d87b271d7592 service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-d9b68ca2-a7ec-4275-a230-0e4d54e90ff7 req-6afd2068-ec17-4e33-be61-d87b271d7592 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] No waiting events found dispatching network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:17:03 user nova-compute[73012]: WARNING nova.compute.manager [req-d9b68ca2-a7ec-4275-a230-0e4d54e90ff7 req-6afd2068-ec17-4e33-be61-d87b271d7592 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received unexpected event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 for instance with vm_state building and task_state spawning.
Aug 14 12:17:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015425.66139, 722de834-9535-4249-91b3-378e4b98f8e0 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:17:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] VM Resumed (Lifecycle Event)
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:17:05 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Instance spawned successfully.
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:17:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015425.6649785, 722de834-9535-4249-91b3-378e4b98f8e0 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:17:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] VM Started (Lifecycle Event)
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-c087909f-5e60-471c-9db5-ee8fbaa52b5c req-d0dec0db-2ba2-43a8-81c6-a969d783fcbb service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c087909f-5e60-471c-9db5-ee8fbaa52b5c req-d0dec0db-2ba2-43a8-81c6-a969d783fcbb service nova] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c087909f-5e60-471c-9db5-ee8fbaa52b5c req-d0dec0db-2ba2-43a8-81c6-a969d783fcbb service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c087909f-5e60-471c-9db5-ee8fbaa52b5c req-d0dec0db-2ba2-43a8-81c6-a969d783fcbb service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-c087909f-5e60-471c-9db5-ee8fbaa52b5c req-d0dec0db-2ba2-43a8-81c6-a969d783fcbb service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] No waiting events found dispatching network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:17:05 user nova-compute[73012]: WARNING nova.compute.manager [req-c087909f-5e60-471c-9db5-ee8fbaa52b5c req-d0dec0db-2ba2-43a8-81c6-a969d783fcbb service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received unexpected event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 for instance with vm_state building and task_state spawning.
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:17:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:17:05 user nova-compute[73012]: INFO nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 14 12:17:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:17:05 user nova-compute[73012]: INFO nova.compute.manager [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Took 7.61 seconds to build instance.
Aug 14 12:17:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7a48645-c432-41ce-a6fc-0815b81eb2b4 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.697s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-13507fea-d6f6-4f90-8133-9774e2c8d25f req-c3b1ef4d-de4a-4040-a7e4-44a66062097a service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received event network-changed-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-13507fea-d6f6-4f90-8133-9774e2c8d25f req-c3b1ef4d-de4a-4040-a7e4-44a66062097a service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Refreshing instance network info cache due to event network-changed-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:17:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-13507fea-d6f6-4f90-8133-9774e2c8d25f req-c3b1ef4d-de4a-4040-a7e4-44a66062097a service nova] Acquiring lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:17:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-13507fea-d6f6-4f90-8133-9774e2c8d25f req-c3b1ef4d-de4a-4040-a7e4-44a66062097a service nova] Acquired lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:17:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-13507fea-d6f6-4f90-8133-9774e2c8d25f req-c3b1ef4d-de4a-4040-a7e4-44a66062097a service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Refreshing network info cache for port 2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:17:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-13507fea-d6f6-4f90-8133-9774e2c8d25f req-c3b1ef4d-de4a-4040-a7e4-44a66062097a service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updated VIF entry in instance network info cache for port 2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:17:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-13507fea-d6f6-4f90-8133-9774e2c8d25f req-c3b1ef4d-de4a-4040-a7e4-44a66062097a service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updating instance_info_cache with network_info: [{"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:17:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-13507fea-d6f6-4f90-8133-9774e2c8d25f req-c3b1ef4d-de4a-4040-a7e4-44a66062097a service nova] Releasing lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:17:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG nova.objects.instance [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:31 user nova-compute[73012]: INFO nova.compute.manager [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attaching volume 3afea9a0-58ab-498e-9f99-808d1e17801d to /dev/vdb
Aug 14 12:17:31 user nova-compute[73012]: DEBUG os_brick.utils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae3ff92-ad46-42bb-8d2a-d93fd9a43776]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2f0dcc-993a-439c-84de-875a0a577c15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bba5ef-5b85-4c72-98f6-a586689a6ba7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f20bec-0e05-40af-8bab-9094501230a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:17:31 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:17:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb58816-69d6-4e0f-b0c3-aa37302809fa]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG os_brick.utils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:17:31 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updating existing volume attachment record: 055ce5ee-b83b-4304-8332-094a19bc1274 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:17:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:33 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:17:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:35 user nova-compute[73012]: INFO nova.compute.manager [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Detaching volume 1d15a83c-3596-476f-a2c3-a3857a560a5e
Aug 14 12:17:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:35 user nova-compute[73012]: INFO nova.virt.block_device [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Attempting to driver detach volume 1d15a83c-3596-476f-a2c3-a3857a560a5e from mountpoint /dev/vdb
Aug 14 12:17:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Attempting to detach device vdb from instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:17:35 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:17:35 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:17:35 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:17:35 user nova-compute[73012]:   <serial>1d15a83c-3596-476f-a2c3-a3857a560a5e</serial>
Aug 14 12:17:35 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 12:17:35 user nova-compute[73012]: </disk>
Aug 14 12:17:35 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:17:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully detached device vdb from instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 from the persistent domain config.
Aug 14 12:17:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:17:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:17:35 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:17:35 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:17:35 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:17:35 user nova-compute[73012]:   <serial>1d15a83c-3596-476f-a2c3-a3857a560a5e</serial>
Aug 14 12:17:35 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 12:17:35 user nova-compute[73012]: </disk>
Aug 14 12:17:35 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015456.3321474, 0d1c12d3-8962-49e8-8ad5-071caee70b94 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:17:36 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully detached device vdb from instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 from the live domain config.
Aug 14 12:17:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQraqtTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:17:36 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0c3d0f-aa1b-4748-80c9-c3d427483649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0aeff6-846a-4d98-b469-b7cce785d5ef]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:17:36 user nova-compute[73012]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:17:36 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:17:36 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e (non-flash)
Aug 14 12:17:36 user nova-compute[73012]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:17:36 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:17:36 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aacf70280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86af616-7ea0-4f46-b06c-f778bc4a3d5b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[749d3b6f-d6a2-4612-825c-d2f90b44f49d]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d484b94e-24fb-4b38-b843-f84a173149e4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5684e398-e7cb-4816-b572-bb7187cd3a28]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca023293-d6a3-4315-81d0-b0fa7cce63e0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded2874f-01a9-4134-92e6-26a9f64487e4]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260]
Aug 14 12:17:36 user nova-compute[73012]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e, portal: 172.16.0.220,3260] successful.
Aug 14 12:17:36 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d15a83c-3596-476f-a2c3-a3857a560a5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2bc8c5-9a13-4afd-9006-397d1b234db4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== disconnect_volume: return (313ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'flavor' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d48de3b4-10f1-415e-9c76-8dc2ce9387c1 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.865s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:17:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:17:40 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:17:40 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7354MB free_disk=25.380416870117188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 634acb0d-490b-4b60-b4f3-947ee8e17457 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance cfa2f996-7907-4490-84d6-c04c5d0ca6e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 722de834-9535-4249-91b3-378e4b98f8e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYwmEPAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:17:40 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:17:40 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:17:40 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2cdbd2-eefb-423f-9547-d2a04ce29818]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:17:40 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6435bd69-b277-4cba-9ebc-0e3a0878f597]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d] added
Aug 14 12:17:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cfa6a2-1843-41c3-a204-bcc17b41dadf]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbfdc70-3887-4bd2-94eb-02d90109b899]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CYwmEPAZ {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CYwmEPAZ" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c36561-6539-4cac-a668-4cef68b94244]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CYwmEPAZ'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e34be6-2713-4077-80a2-8a135fd77644]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1864547-4841-48f4-97bd-aea6e80153cc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:17:40 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:17:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:17:40 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:17:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d7eef7-1804-4382-8a6d-a50808aec2b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d, portal: 172.16.0.220,3260]
Aug 14 12:17:40 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d, portal: 172.16.0.220,3260] successful.
Aug 14 12:17:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ee6f5f-0114-44ac-b611-848fda0782cb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a10856-d239-40e2-bcbf-431b130493ae]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:17:40 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:17:40 user nova-compute[73012]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d (non-flash)
Aug 14 12:17:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:17:40 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:17:40 user nova-compute[73012]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d (non-flash)
Aug 14 12:17:40 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[031d2fc5-6018-417d-a56b-6d32830c4bbb]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:17:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYwmEPAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 66fb72b1-30a9-4be2-b843-7d648fc66e16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23534623561383435', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534623561383435', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG nova.objects.instance [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:17:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:17:41 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:17:41 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:17:41 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:17:41 user nova-compute[73012]:   <serial>3afea9a0-58ab-498e-9f99-808d1e17801d</serial>
Aug 14 12:17:41 user nova-compute[73012]: </disk>
Aug 14 12:17:41 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updating instance_info_cache with network_info: [{"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No VIF found with MAC fa:16:3e:2d:27:fb, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:17:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-40573537-c959-44a6-9964-c507e87a1c43 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.769s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:17:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:54 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:17:54 user nova-compute[73012]: INFO nova.compute.claims [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Claim successful on node user
Aug 14 12:17:55 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:17:55 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:17:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG nova.policy [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7128922092841c49b475af30075e458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac2852176e4d7580080e2320371fe8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:17:55 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Creating image(s)
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk 1073741824" returned: 0 in 0.049s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Cannot resize image /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG nova.objects.instance [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'migration_context' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Ensure instance console log exists: /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Successfully created port: 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:17:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Successfully updated port: 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquired lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-5c3a0895-1f29-4511-9d57-b072607bbe52 req-ca76d45f-79da-4ddb-9662-c43650805bda service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-changed-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-5c3a0895-1f29-4511-9d57-b072607bbe52 req-ca76d45f-79da-4ddb-9662-c43650805bda service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Refreshing instance network info cache due to event network-changed-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5c3a0895-1f29-4511-9d57-b072607bbe52 req-ca76d45f-79da-4ddb-9662-c43650805bda service nova] Acquiring lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updating instance_info_cache with network_info: [{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Releasing lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Instance network_info: |[{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5c3a0895-1f29-4511-9d57-b072607bbe52 req-ca76d45f-79da-4ddb-9662-c43650805bda service nova] Acquired lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.network.neutron [req-5c3a0895-1f29-4511-9d57-b072607bbe52 req-ca76d45f-79da-4ddb-9662-c43650805bda service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Refreshing network info cache for port 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Start _get_guest_xml network_info=[{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:17:57 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:17:57 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1359014402',display_name='tempest-ServerRescueNegativeTestJSON-server-1359014402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1359014402',id=28,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCokD7dXCKAM145fVpuWRhcuXCdxQNaK+YpOqywGLUbdT2cmO+aiYIjn4YEGVfFxlYEUhlqQSZ8T5sIoNQgJF2f1ynoY+lLYv/aWuCkYd7uVSy6jO7Hs3fUaQ0OKHNtz5Q==',key_name='tempest-keypair-737251042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-fjrz43xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:17:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7128922092841c49b475af30075e458',uuid=73fcc85e-48fd-486b-bda8-61d834d8cb42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:de:c7,bridge_name='br-int',has_traffic_filtering=True,id=3f6a975d-16fc-4ff6-aa5a-f8255e577b7f,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6a975d-16') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.objects.instance [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'pci_devices' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:17:57 user nova-compute[73012]:   <uuid>73fcc85e-48fd-486b-bda8-61d834d8cb42</uuid>
Aug 14 12:17:57 user nova-compute[73012]:   <name>instance-0000001c</name>
Aug 14 12:17:57 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:17:57 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:17:57 user nova-compute[73012]:   <metadata>
Aug 14 12:17:57 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:17:57 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:17:57 user nova-compute[73012]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1359014402</nova:name>
Aug 14 12:17:57 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:17:57</nova:creationTime>
Aug 14 12:17:57 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:17:57 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:17:57 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:17:57 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:17:57 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:17:57 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:17:57 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:17:57 user nova-compute[73012]:       <nova:owner>
Aug 14 12:17:57 user nova-compute[73012]:         <nova:user uuid="e7128922092841c49b475af30075e458">tempest-ServerRescueNegativeTestJSON-334705254-project-member</nova:user>
Aug 14 12:17:57 user nova-compute[73012]:         <nova:project uuid="96ac2852176e4d7580080e2320371fe8">tempest-ServerRescueNegativeTestJSON-334705254</nova:project>
Aug 14 12:17:57 user nova-compute[73012]:       </nova:owner>
Aug 14 12:17:57 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:17:57 user nova-compute[73012]:       <nova:ports>
Aug 14 12:17:57 user nova-compute[73012]:         <nova:port uuid="3f6a975d-16fc-4ff6-aa5a-f8255e577b7f">
Aug 14 12:17:57 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:17:57 user nova-compute[73012]:         </nova:port>
Aug 14 12:17:57 user nova-compute[73012]:       </nova:ports>
Aug 14 12:17:57 user nova-compute[73012]:     </nova:instance>
Aug 14 12:17:57 user nova-compute[73012]:   </metadata>
Aug 14 12:17:57 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:17:57 user nova-compute[73012]:     <system>
Aug 14 12:17:57 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:17:57 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:17:57 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:17:57 user nova-compute[73012]:       <entry name="serial">73fcc85e-48fd-486b-bda8-61d834d8cb42</entry>
Aug 14 12:17:57 user nova-compute[73012]:       <entry name="uuid">73fcc85e-48fd-486b-bda8-61d834d8cb42</entry>
Aug 14 12:17:57 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:17:57 user nova-compute[73012]:     </system>
Aug 14 12:17:57 user nova-compute[73012]:   </sysinfo>
Aug 14 12:17:57 user nova-compute[73012]:   <os>
Aug 14 12:17:57 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:17:57 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:17:57 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:17:57 user nova-compute[73012]:   </os>
Aug 14 12:17:57 user nova-compute[73012]:   <features>
Aug 14 12:17:57 user nova-compute[73012]:     <acpi/>
Aug 14 12:17:57 user nova-compute[73012]:     <apic/>
Aug 14 12:17:57 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:17:57 user nova-compute[73012]:   </features>
Aug 14 12:17:57 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:17:57 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:17:57 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:17:57 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:17:57 user nova-compute[73012]:   </clock>
Aug 14 12:17:57 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:17:57 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:17:57 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:17:57 user nova-compute[73012]:   </cpu>
Aug 14 12:17:57 user nova-compute[73012]:   <devices>
Aug 14 12:17:57 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:17:57 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:17:57 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk"/>
Aug 14 12:17:57 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:17:57 user nova-compute[73012]:     </disk>
Aug 14 12:17:57 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:17:57 user nova-compute[73012]:       <mac address="fa:16:3e:6a:de:c7"/>
Aug 14 12:17:57 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:17:57 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:17:57 user nova-compute[73012]:       <target dev="tap3f6a975d-16"/>
Aug 14 12:17:57 user nova-compute[73012]:     </interface>
Aug 14 12:17:57 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:17:57 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/console.log" append="off"/>
Aug 14 12:17:57 user nova-compute[73012]:     </serial>
Aug 14 12:17:57 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:17:57 user nova-compute[73012]:     <video>
Aug 14 12:17:57 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:17:57 user nova-compute[73012]:     </video>
Aug 14 12:17:57 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:17:57 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:17:57 user nova-compute[73012]:     </rng>
Aug 14 12:17:57 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:17:57 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:17:57 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:17:57 user nova-compute[73012]:     </memballoon>
Aug 14 12:17:57 user nova-compute[73012]:   </devices>
Aug 14 12:17:57 user nova-compute[73012]: </domain>
Aug 14 12:17:57 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1359014402',display_name='tempest-ServerRescueNegativeTestJSON-server-1359014402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1359014402',id=28,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCokD7dXCKAM145fVpuWRhcuXCdxQNaK+YpOqywGLUbdT2cmO+aiYIjn4YEGVfFxlYEUhlqQSZ8T5sIoNQgJF2f1ynoY+lLYv/aWuCkYd7uVSy6jO7Hs3fUaQ0OKHNtz5Q==',key_name='tempest-keypair-737251042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-fjrz43xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:17:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7128922092841c49b475af30075e458',uuid=73fcc85e-48fd-486b-bda8-61d834d8cb42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:de:c7,bridge_name='br-int',has_traffic_filtering=True,id=3f6a975d-16fc-4ff6-aa5a-f8255e577b7f,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6a975d-16') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG os_vif [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:de:c7,bridge_name='br-int',has_traffic_filtering=True,id=3f6a975d-16fc-4ff6-aa5a-f8255e577b7f,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6a975d-16') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f6a975d-16, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f6a975d-16, col_values=(('external_ids', {'iface-id': '3f6a975d-16fc-4ff6-aa5a-f8255e577b7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:de:c7', 'vm-uuid': '73fcc85e-48fd-486b-bda8-61d834d8cb42'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:57 user nova-compute[73012]: INFO os_vif [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:de:c7,bridge_name='br-int',has_traffic_filtering=True,id=3f6a975d-16fc-4ff6-aa5a-f8255e577b7f,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6a975d-16')
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:17:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No VIF found with MAC fa:16:3e:6a:de:c7, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:17:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-5c3a0895-1f29-4511-9d57-b072607bbe52 req-ca76d45f-79da-4ddb-9662-c43650805bda service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updated VIF entry in instance network info cache for port 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:17:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-5c3a0895-1f29-4511-9d57-b072607bbe52 req-ca76d45f-79da-4ddb-9662-c43650805bda service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updating instance_info_cache with network_info: [{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:17:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5c3a0895-1f29-4511-9d57-b072607bbe52 req-ca76d45f-79da-4ddb-9662-c43650805bda service nova] Releasing lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-c9c377f8-d765-4901-b269-19acaf4dcddf req-5dd4e125-8215-440c-9cec-b5727ca94ce1 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c9c377f8-d765-4901-b269-19acaf4dcddf req-5dd4e125-8215-440c-9cec-b5727ca94ce1 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c9c377f8-d765-4901-b269-19acaf4dcddf req-5dd4e125-8215-440c-9cec-b5727ca94ce1 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c9c377f8-d765-4901-b269-19acaf4dcddf req-5dd4e125-8215-440c-9cec-b5727ca94ce1 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:17:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-c9c377f8-d765-4901-b269-19acaf4dcddf req-5dd4e125-8215-440c-9cec-b5727ca94ce1 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:17:59 user nova-compute[73012]: WARNING nova.compute.manager [req-c9c377f8-d765-4901-b269-19acaf4dcddf req-5dd4e125-8215-440c-9cec-b5727ca94ce1 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state building and task_state spawning.
Aug 14 12:18:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:00 user nova-compute[73012]: INFO nova.compute.manager [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Rescuing
Aug 14 12:18:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:18:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquired lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:18:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updating instance_info_cache with network_info: [{"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Releasing lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015481.201448, 73fcc85e-48fd-486b-bda8-61d834d8cb42 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:18:01 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] VM Resumed (Lifecycle Event)
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:18:01 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Instance spawned successfully.
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:01 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015481.2061398, 73fcc85e-48fd-486b-bda8-61d834d8cb42 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:18:01 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] VM Started (Lifecycle Event)
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:18:01 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:18:01 user nova-compute[73012]: INFO nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-b6c3229f-c0d2-4856-98d4-a01bd3443d99 req-0b7566ac-0181-4164-b9a8-b92f7c4d5e04 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b6c3229f-c0d2-4856-98d4-a01bd3443d99 req-0b7566ac-0181-4164-b9a8-b92f7c4d5e04 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b6c3229f-c0d2-4856-98d4-a01bd3443d99 req-0b7566ac-0181-4164-b9a8-b92f7c4d5e04 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b6c3229f-c0d2-4856-98d4-a01bd3443d99 req-0b7566ac-0181-4164-b9a8-b92f7c4d5e04 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-b6c3229f-c0d2-4856-98d4-a01bd3443d99 req-0b7566ac-0181-4164-b9a8-b92f7c4d5e04 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:01 user nova-compute[73012]: WARNING nova.compute.manager [req-b6c3229f-c0d2-4856-98d4-a01bd3443d99 req-0b7566ac-0181-4164-b9a8-b92f7c4d5e04 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state building and task_state spawning.
Aug 14 12:18:01 user nova-compute[73012]: INFO nova.compute.manager [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Took 6.75 seconds to build instance.
Aug 14 12:18:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb6f7efd-fd57-40cf-9bf8-b44a30d11630 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.082s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-3c1faaf9-e309-44fd-8e22-8ed6b4f51658 req-03dd912f-62fc-4f70-8b91-2ef09feaf6db service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3c1faaf9-e309-44fd-8e22-8ed6b4f51658 req-03dd912f-62fc-4f70-8b91-2ef09feaf6db service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3c1faaf9-e309-44fd-8e22-8ed6b4f51658 req-03dd912f-62fc-4f70-8b91-2ef09feaf6db service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3c1faaf9-e309-44fd-8e22-8ed6b4f51658 req-03dd912f-62fc-4f70-8b91-2ef09feaf6db service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-3c1faaf9-e309-44fd-8e22-8ed6b4f51658 req-03dd912f-62fc-4f70-8b91-2ef09feaf6db service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:01 user nova-compute[73012]: WARNING nova.compute.manager [req-3c1faaf9-e309-44fd-8e22-8ed6b4f51658 req-03dd912f-62fc-4f70-8b91-2ef09feaf6db service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state active and task_state rescuing.
Aug 14 12:18:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:01 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Instance destroyed successfully.
Aug 14 12:18:01 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Attempting a stable device rescue
Aug 14 12:18:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73012) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 12:18:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Instance directory exists: not creating {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 12:18:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Creating image(s)
Aug 14 12:18:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "/opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "/opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "807eddc87bd233fed525e056e54252170e4a118f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "807eddc87bd233fed525e056e54252170e4a118f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-ef2521d6-fb54-4f45-b888-24ef82c1afd3 req-88d08823-f41f-4a90-9a2e-6fc061a6b3ed service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ef2521d6-fb54-4f45-b888-24ef82c1afd3 req-88d08823-f41f-4a90-9a2e-6fc061a6b3ed service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ef2521d6-fb54-4f45-b888-24ef82c1afd3 req-88d08823-f41f-4a90-9a2e-6fc061a6b3ed service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ef2521d6-fb54-4f45-b888-24ef82c1afd3 req-88d08823-f41f-4a90-9a2e-6fc061a6b3ed service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-ef2521d6-fb54-4f45-b888-24ef82c1afd3 req-88d08823-f41f-4a90-9a2e-6fc061a6b3ed service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:03 user nova-compute[73012]: WARNING nova.compute.manager [req-ef2521d6-fb54-4f45-b888-24ef82c1afd3 req-88d08823-f41f-4a90-9a2e-6fc061a6b3ed service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state active and task_state rescuing.
Aug 14 12:18:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f.part --force-share --output=json" returned: 0 in 0.486s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG nova.virt.images [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] dedb090f-d935-47cd-a19a-00a35ad76272 was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:18:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f.part /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f.part /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f.converted" returned: 0 in 0.507s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "807eddc87bd233fed525e056e54252170e4a118f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.400s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "807eddc87bd233fed525e056e54252170e4a118f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "807eddc87bd233fed525e056e54252170e4a118f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f,backing_fmt=raw /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f,backing_fmt=raw /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue" returned: 0 in 0.051s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "807eddc87bd233fed525e056e54252170e4a118f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'migration_context' on Instance uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Start _get_guest_xml network_info=[{"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "vif_mac": "fa:16:3e:47:51:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dedb090f-d935-47cd-a19a-00a35ad76272', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxtUdajk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4f831e0c-5249-461a-a00a-484c59da5a8a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3829322-cb1f-40f1-8ba0-8ab60eb116e9', 'serial': 'f3829322-cb1f-40f1-8ba0-8ab60eb116e9'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '7f2f81a2-dab4-4bdd-b5c1-a3ff3b68c720', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'resources' on Instance uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:04 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:18:04 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxtUdajk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:18:04 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:18:04 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:18:04 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeec0cd-9ba5-4a87-81a9-1e41f3ead6c9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PxtUdajk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 12:18:04 user nova-compute[73012]: node.name = iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9
Aug 14 12:18:04 user nova-compute[73012]: node.tpgt = -1
Aug 14 12:18:04 user nova-compute[73012]: node.startup = automatic
Aug 14 12:18:04 user nova-compute[73012]: node.leading_login = No
Aug 14 12:18:04 user nova-compute[73012]: iface.iscsi_ifacename = default
Aug 14 12:18:04 user nova-compute[73012]: iface.net_ifacename = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.ipaddress = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.prefix_len = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.hwaddress = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.transport_name = tcp
Aug 14 12:18:04 user nova-compute[73012]: iface.initiatorname = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.state = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.vlan_id = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.vlan_priority = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.vlan_state = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.iface_num = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.mtu = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.port = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.bootproto = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.subnet_mask = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.gateway = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.dhcp_alt_client_id = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.dhcp_dns = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.dhcp_learn_iqn = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.dhcp_vendor_id_state = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.dhcp_vendor_id = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.dhcp_slp_da = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.fragmentation = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.gratuitous_arp = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.incoming_forwarding = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.tos_state = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.tos = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.ttl = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.delayed_ack = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.tcp_nagle = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.tcp_wsf_state = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.tcp_wsf = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.tcp_timer_scale = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.tcp_timestamp = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.redirect = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.def_task_mgmt_timeout = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.header_digest = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.data_digest = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.immediate_data = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.initial_r2t = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.data_seq_inorder = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.data_pdu_inorder = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.erl = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.max_receive_data_len = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.first_burst_len = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.max_outstanding_r2t = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.max_burst_len = 0
Aug 14 12:18:04 user nova-compute[73012]: iface.chap_auth = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.bidi_chap = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.strict_login_compliance = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.discovery_auth = <empty>
Aug 14 12:18:04 user nova-compute[73012]: iface.discovery_logout = <empty>
Aug 14 12:18:04 user nova-compute[73012]: node.discovery_address = <empty>
Aug 14 12:18:04 user nova-compute[73012]: node.discovery_port = 0
Aug 14 12:18:04 user nova-compute[73012]: node.discovery_type = static
Aug 14 12:18:04 user nova-compute[73012]: node.session.initial_cmdsn = 0
Aug 14 12:18:04 user nova-compute[73012]: node.session.initial_login_retry_max = 8
Aug 14 12:18:04 user nova-compute[73012]: node.session.xmit_thread_priority = -20
Aug 14 12:18:04 user nova-compute[73012]: node.session.cmds_max = 128
Aug 14 12:18:04 user nova-compute[73012]: node.session.queue_depth = 32
Aug 14 12:18:04 user nova-compute[73012]: node.session.nr_sessions = 1
Aug 14 12:18:04 user nova-compute[73012]: node.session.auth.authmethod = CHAP
Aug 14 12:18:04 user nova-compute[73012]: node.session.auth.username = PxtUdajk
Aug 14 12:18:04 user nova-compute[73012]: node.session.auth.password = ***
Aug 14 12:18:04 user nova-compute[73012]: node.session.auth.username_in = <empty>
Aug 14 12:18:04 user nova-compute[73012]: node.session.auth.password_in = <empty>
Aug 14 12:18:04 user nova-compute[73012]: node.session.auth.chap_algs = MD5
Aug 14 12:18:04 user nova-compute[73012]: node.session.timeo.replacement_timeout = 120
Aug 14 12:18:04 user nova-compute[73012]: node.session.err_timeo.abort_timeout = 15
Aug 14 12:18:04 user nova-compute[73012]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 12:18:04 user nova-compute[73012]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 12:18:04 user nova-compute[73012]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.FastAbort = Yes
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.InitialR2T = No
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.ImmediateData = Yes
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.MaxConnections = 1
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 12:18:04 user nova-compute[73012]: node.session.iscsi.ERL = 0
Aug 14 12:18:04 user nova-compute[73012]: node.session.scan = manual
Aug 14 12:18:04 user nova-compute[73012]: node.session.reopen_max = 0
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].address = 172.16.0.220
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].port = 3260
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].startup = manual
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].tcp.window_size = 524288
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].tcp.type_of_service = 0
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].timeo.logout_timeout = 15
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].timeo.login_timeout = 15
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].timeo.auth_timeout = 45
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].iscsi.DataDigest = None
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].iscsi.IFMarker = No
Aug 14 12:18:04 user nova-compute[73012]: node.conn[0].iscsi.OFMarker = No
Aug 14 12:18:04 user nova-compute[73012]: # END RECORD
Aug 14 12:18:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8778411a-fd26-43c3-b978-4a4efc005601]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a8ac7f-e8ca-4a36-98c2-b93541439c53]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxtUdajk {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxtUdajk" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c5d6c8-2cb5-463f-bbd3-74f6b31a0ea5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxtUdajk'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d076460-47a7-48e5-908a-fbcbc28703f3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4808be-d1a2-47df-a399-15ee8c730624]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:18:04 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:18:04 user nova-compute[73012]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d (non-flash)
Aug 14 12:18:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:18:04 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:18:04 user nova-compute[73012]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d (non-flash)
Aug 14 12:18:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] HCTL ('33', '0', '0', 0) found on session 25 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:18:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7cecaa-d773-4cde-af62-eb85db13da4b]: (4, ('0 0 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching for a device in session 25 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxtUdajk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.192s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '23938653963656330', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938653963656330', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-50514846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-50514846',id=26,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:16:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-9j75e963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:16:36Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=4f831e0c-5249-461a-a00a-484c59da5a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "vif_mac": "fa:16:3e:47:51:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "vif_mac": "fa:16:3e:47:51:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:51:79,bridge_name='br-int',has_traffic_filtering=True,id=f1955c5d-ee34-4117-b651-daa2cc4b5002,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1955c5d-ee') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:18:05 user nova-compute[73012]:   <uuid>4f831e0c-5249-461a-a00a-484c59da5a8a</uuid>
Aug 14 12:18:05 user nova-compute[73012]:   <name>instance-0000001a</name>
Aug 14 12:18:05 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:18:05 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:18:05 user nova-compute[73012]:   <metadata>
Aug 14 12:18:05 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:18:05 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:18:05 user nova-compute[73012]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-50514846</nova:name>
Aug 14 12:18:05 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:18:04</nova:creationTime>
Aug 14 12:18:05 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:18:05 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:18:05 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:18:05 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:18:05 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:18:05 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:18:05 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:18:05 user nova-compute[73012]:       <nova:owner>
Aug 14 12:18:05 user nova-compute[73012]:         <nova:user uuid="ae1ce3345617447486642ebe88c1621c">tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member</nova:user>
Aug 14 12:18:05 user nova-compute[73012]:         <nova:project uuid="6b1960abc96445f483386773f67d83e3">tempest-ServerBootFromVolumeStableRescueTest-1756944789</nova:project>
Aug 14 12:18:05 user nova-compute[73012]:       </nova:owner>
Aug 14 12:18:05 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:18:05 user nova-compute[73012]:       <nova:ports>
Aug 14 12:18:05 user nova-compute[73012]:         <nova:port uuid="f1955c5d-ee34-4117-b651-daa2cc4b5002">
Aug 14 12:18:05 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 12:18:05 user nova-compute[73012]:         </nova:port>
Aug 14 12:18:05 user nova-compute[73012]:       </nova:ports>
Aug 14 12:18:05 user nova-compute[73012]:     </nova:instance>
Aug 14 12:18:05 user nova-compute[73012]:   </metadata>
Aug 14 12:18:05 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:18:05 user nova-compute[73012]:     <system>
Aug 14 12:18:05 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:18:05 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:18:05 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:18:05 user nova-compute[73012]:       <entry name="serial">4f831e0c-5249-461a-a00a-484c59da5a8a</entry>
Aug 14 12:18:05 user nova-compute[73012]:       <entry name="uuid">4f831e0c-5249-461a-a00a-484c59da5a8a</entry>
Aug 14 12:18:05 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:18:05 user nova-compute[73012]:     </system>
Aug 14 12:18:05 user nova-compute[73012]:   </sysinfo>
Aug 14 12:18:05 user nova-compute[73012]:   <os>
Aug 14 12:18:05 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:18:05 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:18:05 user nova-compute[73012]:   </os>
Aug 14 12:18:05 user nova-compute[73012]:   <features>
Aug 14 12:18:05 user nova-compute[73012]:     <acpi/>
Aug 14 12:18:05 user nova-compute[73012]:     <apic/>
Aug 14 12:18:05 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:18:05 user nova-compute[73012]:   </features>
Aug 14 12:18:05 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:18:05 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:18:05 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:18:05 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:18:05 user nova-compute[73012]:   </clock>
Aug 14 12:18:05 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:18:05 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:18:05 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:18:05 user nova-compute[73012]:   </cpu>
Aug 14 12:18:05 user nova-compute[73012]:   <devices>
Aug 14 12:18:05 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:18:05 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:18:05 user nova-compute[73012]:       <source dev="/dev/sdb"/>
Aug 14 12:18:05 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:18:05 user nova-compute[73012]:       <serial>f3829322-cb1f-40f1-8ba0-8ab60eb116e9</serial>
Aug 14 12:18:05 user nova-compute[73012]:     </disk>
Aug 14 12:18:05 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:18:05 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:18:05 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue"/>
Aug 14 12:18:05 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:18:05 user nova-compute[73012]:       <boot order="1"/>
Aug 14 12:18:05 user nova-compute[73012]:     </disk>
Aug 14 12:18:05 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:18:05 user nova-compute[73012]:       <mac address="fa:16:3e:47:51:79"/>
Aug 14 12:18:05 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:18:05 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:18:05 user nova-compute[73012]:       <target dev="tapf1955c5d-ee"/>
Aug 14 12:18:05 user nova-compute[73012]:     </interface>
Aug 14 12:18:05 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:18:05 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/console.log" append="off"/>
Aug 14 12:18:05 user nova-compute[73012]:     </serial>
Aug 14 12:18:05 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:18:05 user nova-compute[73012]:     <video>
Aug 14 12:18:05 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:18:05 user nova-compute[73012]:     </video>
Aug 14 12:18:05 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:18:05 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:18:05 user nova-compute[73012]:     </rng>
Aug 14 12:18:05 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:18:05 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:18:05 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:18:05 user nova-compute[73012]:     </memballoon>
Aug 14 12:18:05 user nova-compute[73012]:   </devices>
Aug 14 12:18:05 user nova-compute[73012]: </domain>
Aug 14 12:18:05 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:18:05 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Instance destroyed successfully.
Aug 14 12:18:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:18:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No VIF found with MAC fa:16:3e:47:51:79, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:18:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-c173b06d-08cd-4847-a79d-b2b428b1ceee req-142804d9-ce5f-4ee2-9b38-57424150411f service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c173b06d-08cd-4847-a79d-b2b428b1ceee req-142804d9-ce5f-4ee2-9b38-57424150411f service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c173b06d-08cd-4847-a79d-b2b428b1ceee req-142804d9-ce5f-4ee2-9b38-57424150411f service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c173b06d-08cd-4847-a79d-b2b428b1ceee req-142804d9-ce5f-4ee2-9b38-57424150411f service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-c173b06d-08cd-4847-a79d-b2b428b1ceee req-142804d9-ce5f-4ee2-9b38-57424150411f service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:06 user nova-compute[73012]: WARNING nova.compute.manager [req-c173b06d-08cd-4847-a79d-b2b428b1ceee req-142804d9-ce5f-4ee2-9b38-57424150411f service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state active and task_state rescuing.
Aug 14 12:18:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:07 user nova-compute[73012]: INFO nova.compute.manager [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Detaching volume 3afea9a0-58ab-498e-9f99-808d1e17801d
Aug 14 12:18:07 user nova-compute[73012]: INFO nova.virt.block_device [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attempting to driver detach volume 3afea9a0-58ab-498e-9f99-808d1e17801d from mountpoint /dev/vdb
Aug 14 12:18:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Attempting to detach device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:18:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:18:07 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:18:07 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:18:07 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:18:07 user nova-compute[73012]:   <serial>3afea9a0-58ab-498e-9f99-808d1e17801d</serial>
Aug 14 12:18:07 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:18:07 user nova-compute[73012]: </disk>
Aug 14 12:18:07 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:18:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully detached device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the persistent domain config.
Aug 14 12:18:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:18:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:18:07 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:18:07 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:18:07 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:18:07 user nova-compute[73012]:   <serial>3afea9a0-58ab-498e-9f99-808d1e17801d</serial>
Aug 14 12:18:07 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:18:07 user nova-compute[73012]: </disk>
Aug 14 12:18:07 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015488.1754735, 8e51a9ce-cd61-4c43-a297-7f313bf2a07c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:18:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully detached device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the live domain config.
Aug 14 12:18:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYwmEPAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:18:08 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e31ba67-2e33-4640-ac11-ab1a7ae54a2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8283d0-3784-4d4e-9487-cff230461f61]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:18:08 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:18:08 user nova-compute[73012]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d (non-flash)
Aug 14 12:18:08 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:18:08 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:18:08 user nova-compute[73012]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d (non-flash)
Aug 14 12:18:08 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9af01f7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab82fbc-d1e6-48c7-ab71-243d8e9a1681]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35dce09-d9e9-4b6d-8dbb-88fd0dbbd6ee]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92a0595-25fe-41e5-8e32-74d0f50642bc]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf8776-91cb-481f-9e6a-c99ee0484af7]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e70dd-3a35-4aee-ae34-357fc0a7adf2]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[984c02fa-746e-4590-a310-203fdf10f9a4]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d, portal: 172.16.0.220,3260]
Aug 14 12:18:08 user nova-compute[73012]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d, portal: 172.16.0.220,3260] successful.
Aug 14 12:18:08 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3afea9a0-58ab-498e-9f99-808d1e17801d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f36db1-d177-4b53-ae4f-7210fd840d78]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== disconnect_volume: return (263ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-a02c3bc8-7f88-4614-8a44-e82fd59a7a7e req-42e7c200-ada7-445b-af2e-fa5a430ec6a3 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a02c3bc8-7f88-4614-8a44-e82fd59a7a7e req-42e7c200-ada7-445b-af2e-fa5a430ec6a3 service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a02c3bc8-7f88-4614-8a44-e82fd59a7a7e req-42e7c200-ada7-445b-af2e-fa5a430ec6a3 service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a02c3bc8-7f88-4614-8a44-e82fd59a7a7e req-42e7c200-ada7-445b-af2e-fa5a430ec6a3 service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-a02c3bc8-7f88-4614-8a44-e82fd59a7a7e req-42e7c200-ada7-445b-af2e-fa5a430ec6a3 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:08 user nova-compute[73012]: WARNING nova.compute.manager [req-a02c3bc8-7f88-4614-8a44-e82fd59a7a7e req-42e7c200-ada7-445b-af2e-fa5a430ec6a3 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state active and task_state rescuing.
Aug 14 12:18:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for 4f831e0c-5249-461a-a00a-484c59da5a8a due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:18:09 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015489.1627634, 4f831e0c-5249-461a-a00a-484c59da5a8a => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:18:09 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] VM Resumed (Lifecycle Event)
Aug 14 12:18:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7dcca70b-452d-4c2f-8ca3-4a2b378abf8c tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:18:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:18:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:18:09 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 12:18:09 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015489.1639004, 4f831e0c-5249-461a-a00a-484c59da5a8a => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:18:09 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] VM Started (Lifecycle Event)
Aug 14 12:18:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:18:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:18:09 user nova-compute[73012]: DEBUG nova.objects.instance [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-249089f0-686b-4da0-89fd-9a6db69df1ac tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.781s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.013s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:12 user nova-compute[73012]: INFO nova.compute.manager [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Terminating instance
Aug 14 12:18:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-36dacb08-9298-43a1-aea0-6690d68b7862 req-13d219ef-34e6-4337-bc37-fd841ee59cf9 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-unplugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-36dacb08-9298-43a1-aea0-6690d68b7862 req-13d219ef-34e6-4337-bc37-fd841ee59cf9 service nova] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-36dacb08-9298-43a1-aea0-6690d68b7862 req-13d219ef-34e6-4337-bc37-fd841ee59cf9 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-36dacb08-9298-43a1-aea0-6690d68b7862 req-13d219ef-34e6-4337-bc37-fd841ee59cf9 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-36dacb08-9298-43a1-aea0-6690d68b7862 req-13d219ef-34e6-4337-bc37-fd841ee59cf9 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] No waiting events found dispatching network-vif-unplugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-36dacb08-9298-43a1-aea0-6690d68b7862 req-13d219ef-34e6-4337-bc37-fd841ee59cf9 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-unplugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:18:13 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Instance destroyed successfully.
Aug 14 12:18:13 user nova-compute[73012]: DEBUG nova.objects.instance [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lazy-loading 'resources' on Instance uuid 634acb0d-490b-4b60-b4f3-947ee8e17457 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-796497097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-967795420',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiv02NM7ly/GsobICpDT6xbGxQ/k8nXI2xD8KWTJ9NU7/1N/75H+g01HY/tgKIHkAjxMPMd5Bq1WB9THdIdhcSq+a2ng7zU/CwAUcMVT8u8+mSuR2gDPxvR8Awu4NKL/Q==',key_name='tempest-keypair-989125677',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26d8edb773fa44bc847d02cac0a00483',ramdisk_id='',reservation_id='r-wetm1wbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-169217537',owner_user_name='tempest-ServerActionsV293TestJSON-169217537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f6ace32c7b422ebe6f0d6f5d179988',uuid=634acb0d-490b-4b60-b4f3-947ee8e17457,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converting VIF {"id": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "address": "fa:16:3e:ec:ab:72", "network": {"id": "9a437bae-11ef-4aae-9668-787eb51430b8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1380997891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26d8edb773fa44bc847d02cac0a00483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ece2ed-0a", "ovs_interfaceid": "c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_vif [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0ece2ed-0a, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:13 user nova-compute[73012]: INFO os_vif [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:72,bridge_name='br-int',has_traffic_filtering=True,id=c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860,network=Network(9a437bae-11ef-4aae-9668-787eb51430b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ece2ed-0a')
Aug 14 12:18:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHSAcFGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:18:13 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe6dcae-efb0-46c2-95e9-b473731b384c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6321890c-2583-4742-9c19-433ecccee472]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:18:13 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:18:13 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:18:13 user nova-compute[73012]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 (non-flash)
Aug 14 12:18:13 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad05c69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb9b9c7-fbf9-4253-b6fb-d708cfa28e04]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[45403d09-f5de-4bd0-b050-db88dc4bb900]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3319869a-13ca-4347-ba20-5ca75b40ff34]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f34552c-87d8-45a1-8713-a0102322647d]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_68106b59', '/dev/disk/by-id/scsi-1SCST_BIO68106b59-d3d485566baacb38', '/dev/disk/by-id/scsi-26433643438353536') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8c9fde-1125-4cfb-84e0-5d9d9be8b963]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3973f3-adc3-4a66-bf87-9f1baa78eb4e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f93099-45c0-4d76-a611-4813415db4f6]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260]
Aug 14 12:18:14 user nova-compute[73012]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38, portal: 172.16.0.220,3260] successful.
Aug 14 12:18:14 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79f9156a-c066-4074-a84c-90e59b36fc38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7019214c-97be-4c72-a0b3-84ac947d736c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] <== disconnect_volume: return (318ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:18:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Deleting instance files /opt/stack/data/nova/instances/634acb0d-490b-4b60-b4f3-947ee8e17457_del
Aug 14 12:18:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Deletion of /opt/stack/data/nova/instances/634acb0d-490b-4b60-b4f3-947ee8e17457_del complete
Aug 14 12:18:14 user nova-compute[73012]: INFO nova.compute.manager [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 14 12:18:14 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:18:14 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:18:15 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:18:15 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Took 0.91 seconds to deallocate network for instance.
Aug 14 12:18:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-4d62c401-08e6-4c2d-b735-b2e0990d3413 req-da49291d-5734-4e5a-b5d7-c15793a76ef1 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-deleted-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-ab95f61d-af61-4467-b3cf-ae4df2807907 req-ac5650af-f642-4e54-a3b0-9921326321a3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ab95f61d-af61-4467-b3cf-ae4df2807907 req-ac5650af-f642-4e54-a3b0-9921326321a3 service nova] Acquiring lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ab95f61d-af61-4467-b3cf-ae4df2807907 req-ac5650af-f642-4e54-a3b0-9921326321a3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ab95f61d-af61-4467-b3cf-ae4df2807907 req-ac5650af-f642-4e54-a3b0-9921326321a3 service nova] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-ab95f61d-af61-4467-b3cf-ae4df2807907 req-ac5650af-f642-4e54-a3b0-9921326321a3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] No waiting events found dispatching network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:15 user nova-compute[73012]: WARNING nova.compute.manager [req-ab95f61d-af61-4467-b3cf-ae4df2807907 req-ac5650af-f642-4e54-a3b0-9921326321a3 service nova] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Received unexpected event network-vif-plugged-c0ece2ed-0ad6-4f60-b5a5-5a0b04db7860 for instance with vm_state active and task_state deleting.
Aug 14 12:18:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:15 user nova-compute[73012]: INFO nova.compute.manager [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Took 0.72 seconds to detach 1 volumes for instance.
Aug 14 12:18:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Deleting volume: 79f9156a-c066-4074-a84c-90e59b36fc38 {{(pid=73012) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 12:18:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:16 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:18:16 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:18:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:16 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Deleted allocations for instance 634acb0d-490b-4b60-b4f3-947ee8e17457
Aug 14 12:18:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-529adae7-749d-4542-beeb-85968ac22aa7 tempest-ServerActionsV293TestJSON-169217537 tempest-ServerActionsV293TestJSON-169217537-project-member] Lock "634acb0d-490b-4b60-b4f3-947ee8e17457" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.583s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:26 user nova-compute[73012]: INFO nova.compute.manager [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Terminating instance
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-43e8a101-3f3b-4930-995e-9f4e6da058d3 req-62027324-e9f3-4df9-81d5-49f33415df9e service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-unplugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-43e8a101-3f3b-4930-995e-9f4e6da058d3 req-62027324-e9f3-4df9-81d5-49f33415df9e service nova] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-43e8a101-3f3b-4930-995e-9f4e6da058d3 req-62027324-e9f3-4df9-81d5-49f33415df9e service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-43e8a101-3f3b-4930-995e-9f4e6da058d3 req-62027324-e9f3-4df9-81d5-49f33415df9e service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-43e8a101-3f3b-4930-995e-9f4e6da058d3 req-62027324-e9f3-4df9-81d5-49f33415df9e service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] No waiting events found dispatching network-vif-unplugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-43e8a101-3f3b-4930-995e-9f4e6da058d3 req-62027324-e9f3-4df9-81d5-49f33415df9e service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-unplugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Instance destroyed successfully.
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'resources' on Instance uuid 0d1c12d3-8962-49e8-8ad5-071caee70b94 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:12:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1993015962',display_name='tempest-ServerActionsTestOtherA-server-1065965344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1993015962',id=21,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtgn7jI0ij2H9jUYjkccKsYICC7IYYfLPdrPhf/txsC9h/wIuzHlUOu4tO1XNh3I/gHCdax/I0yp+dw9TF/JX47JXH1n7A4tRx6CChv+xyFdBvhBqcME74oyp+lIXw0hQ==',key_name='tempest-keypair-427987902',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:15:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-k5j0guq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:15:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=0d1c12d3-8962-49e8-8ad5-071caee70b94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "address": "fa:16:3e:07:9f:e3", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3cb9338-9b", "ovs_interfaceid": "a3cb9338-9b9e-48ed-9da8-1cef3094170d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG os_vif [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3cb9338-9b, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:18:26 user nova-compute[73012]: INFO os_vif [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:e3,bridge_name='br-int',has_traffic_filtering=True,id=a3cb9338-9b9e-48ed-9da8-1cef3094170d,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3cb9338-9b')
Aug 14 12:18:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Deleting instance files /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94_del
Aug 14 12:18:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Deletion of /opt/stack/data/nova/instances/0d1c12d3-8962-49e8-8ad5-071caee70b94_del complete
Aug 14 12:18:26 user nova-compute[73012]: INFO nova.compute.manager [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 14 12:18:26 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:18:26 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:18:27 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:18:27 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Took 0.86 seconds to deallocate network for instance.
Aug 14 12:18:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-0cd0a989-9c4b-4968-b836-f956adbe7936 req-a35202b3-fa5d-4aa7-b119-9c74a4e3613c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-deleted-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:27 user nova-compute[73012]: INFO nova.compute.manager [req-0cd0a989-9c4b-4968-b836-f956adbe7936 req-a35202b3-fa5d-4aa7-b119-9c74a4e3613c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Neutron deleted interface a3cb9338-9b9e-48ed-9da8-1cef3094170d; detaching it from the instance and deleting it from the info cache
Aug 14 12:18:27 user nova-compute[73012]: DEBUG nova.network.neutron [req-0cd0a989-9c4b-4968-b836-f956adbe7936 req-a35202b3-fa5d-4aa7-b119-9c74a4e3613c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:18:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-0cd0a989-9c4b-4968-b836-f956adbe7936 req-a35202b3-fa5d-4aa7-b119-9c74a4e3613c service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Detach interface failed, port_id=a3cb9338-9b9e-48ed-9da8-1cef3094170d, reason: Instance 0d1c12d3-8962-49e8-8ad5-071caee70b94 could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:18:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:28 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:18:28 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:18:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:28 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Deleted allocations for instance 0d1c12d3-8962-49e8-8ad5-071caee70b94
Aug 14 12:18:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cec751ab-b8c6-4ad1-acf7-f82d383c893a tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.212s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-3088a906-d54b-41ca-82f0-94d127055e1b req-d2850edb-b9c8-4c45-8a5f-5bc47b9a6f60 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3088a906-d54b-41ca-82f0-94d127055e1b req-d2850edb-b9c8-4c45-8a5f-5bc47b9a6f60 service nova] Acquiring lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3088a906-d54b-41ca-82f0-94d127055e1b req-d2850edb-b9c8-4c45-8a5f-5bc47b9a6f60 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3088a906-d54b-41ca-82f0-94d127055e1b req-d2850edb-b9c8-4c45-8a5f-5bc47b9a6f60 service nova] Lock "0d1c12d3-8962-49e8-8ad5-071caee70b94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-3088a906-d54b-41ca-82f0-94d127055e1b req-d2850edb-b9c8-4c45-8a5f-5bc47b9a6f60 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] No waiting events found dispatching network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:28 user nova-compute[73012]: WARNING nova.compute.manager [req-3088a906-d54b-41ca-82f0-94d127055e1b req-d2850edb-b9c8-4c45-8a5f-5bc47b9a6f60 service nova] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Received unexpected event network-vif-plugged-a3cb9338-9b9e-48ed-9da8-1cef3094170d for instance with vm_state deleted and task_state None.
Aug 14 12:18:28 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015493.7170875, 634acb0d-490b-4b60-b4f3-947ee8e17457 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:18:28 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] VM Stopped (Lifecycle Event)
Aug 14 12:18:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9117bb05-610d-42e3-9c7e-1f3fdd4faa5e None None] [instance: 634acb0d-490b-4b60-b4f3-947ee8e17457] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:18:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:18:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:33 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:18:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:18:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:18:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:18:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:37 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:18:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:18:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:18:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:18:37 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updating instance_info_cache with network_info: [{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:38 user nova-compute[73012]: INFO nova.compute.manager [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Terminating instance
Aug 14 12:18:38 user nova-compute[73012]: DEBUG nova.compute.manager [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-b2669148-e28e-44bd-8739-8470e4bb95d0 req-2cec8356-49e8-4dfc-adfc-89b43906298e service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-unplugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b2669148-e28e-44bd-8739-8470e4bb95d0 req-2cec8356-49e8-4dfc-adfc-89b43906298e service nova] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b2669148-e28e-44bd-8739-8470e4bb95d0 req-2cec8356-49e8-4dfc-adfc-89b43906298e service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b2669148-e28e-44bd-8739-8470e4bb95d0 req-2cec8356-49e8-4dfc-adfc-89b43906298e service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-b2669148-e28e-44bd-8739-8470e4bb95d0 req-2cec8356-49e8-4dfc-adfc-89b43906298e service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] No waiting events found dispatching network-vif-unplugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-b2669148-e28e-44bd-8739-8470e4bb95d0 req-2cec8356-49e8-4dfc-adfc-89b43906298e service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-unplugged-c652878c-a896-4c3f-8108-ec1157747dd8 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:39 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Instance destroyed successfully.
Aug 14 12:18:39 user nova-compute[73012]: DEBUG nova.objects.instance [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lazy-loading 'resources' on Instance uuid cfa2f996-7907-4490-84d6-c04c5d0ca6e5 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T12:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-838748235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-838748235',id=22,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCV5mRNytxsnHEHhX2uJ4TIFUR6h3MrD/JjWu07t8+cOMMt8KeSmdhu7LxlHAmPyRFLqS8Z5Vg9nlht/gXkJmEiwnTatdpAZwx6xjN1iITv9/VgSvjTaPrb/5C0hzuXLmg==',key_name='tempest-keypair-859094030',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b522100e4bf447e3b544983c451c3786',ramdisk_id='',reservation_id='r-f2gn3cvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-192114773',owner_user_name='tempest-AttachVolumeShelveTestJSON-192114773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7648caa38d8e4de6bf9751a512ffb14a',uuid=cfa2f996-7907-4490-84d6-c04c5d0ca6e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converting VIF {"id": "c652878c-a896-4c3f-8108-ec1157747dd8", "address": "fa:16:3e:8d:6f:90", "network": {"id": "3d1bbbd8-6840-4f84-9616-609a49a5fe73", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-862531945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b522100e4bf447e3b544983c451c3786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652878c-a8", "ovs_interfaceid": "c652878c-a896-4c3f-8108-ec1157747dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG os_vif [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc652878c-a8, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:18:39 user nova-compute[73012]: INFO os_vif [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=c652878c-a896-4c3f-8108-ec1157747dd8,network=Network(3d1bbbd8-6840-4f84-9616-609a49a5fe73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc652878c-a8')
Aug 14 12:18:39 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Deleting instance files /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5_del
Aug 14 12:18:39 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Deletion of /opt/stack/data/nova/instances/cfa2f996-7907-4490-84d6-c04c5d0ca6e5_del complete
Aug 14 12:18:39 user nova-compute[73012]: INFO nova.compute.manager [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:40 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid 'cfa2f996-7907-4490-84d6-c04c5d0ca6e5' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid 'cfa2f996-7907-4490-84d6-c04c5d0ca6e5' (instance-00000016)
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-05888487-e764-4022-8366-9d9c2cc8df8f req-fd6c005a-1b18-46e7-b442-1711debe58a3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-deleted-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:40 user nova-compute[73012]: INFO nova.compute.manager [req-05888487-e764-4022-8366-9d9c2cc8df8f req-fd6c005a-1b18-46e7-b442-1711debe58a3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Neutron deleted interface c652878c-a896-4c3f-8108-ec1157747dd8; detaching it from the instance and deleting it from the info cache
Aug 14 12:18:40 user nova-compute[73012]: DEBUG nova.network.neutron [req-05888487-e764-4022-8366-9d9c2cc8df8f req-fd6c005a-1b18-46e7-b442-1711debe58a3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-05888487-e764-4022-8366-9d9c2cc8df8f req-fd6c005a-1b18-46e7-b442-1711debe58a3 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Detach interface failed, port_id=c652878c-a896-4c3f-8108-ec1157747dd8, reason: Instance cfa2f996-7907-4490-84d6-c04c5d0ca6e5 could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:18:40 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Took 1.42 seconds to deallocate network for instance.
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-51dbd8d7-0112-429f-984b-3f1ff0b2c295 req-368015a4-0156-4db0-b5dd-2f4dfdcecc47 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-51dbd8d7-0112-429f-984b-3f1ff0b2c295 req-368015a4-0156-4db0-b5dd-2f4dfdcecc47 service nova] Acquiring lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-51dbd8d7-0112-429f-984b-3f1ff0b2c295 req-368015a4-0156-4db0-b5dd-2f4dfdcecc47 service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-51dbd8d7-0112-429f-984b-3f1ff0b2c295 req-368015a4-0156-4db0-b5dd-2f4dfdcecc47 service nova] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-51dbd8d7-0112-429f-984b-3f1ff0b2c295 req-368015a4-0156-4db0-b5dd-2f4dfdcecc47 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] No waiting events found dispatching network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:18:40 user nova-compute[73012]: WARNING nova.compute.manager [req-51dbd8d7-0112-429f-984b-3f1ff0b2c295 req-368015a4-0156-4db0-b5dd-2f4dfdcecc47 service nova] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Received unexpected event network-vif-plugged-c652878c-a896-4c3f-8108-ec1157747dd8 for instance with vm_state active and task_state deleting.
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:41 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Deleted allocations for instance cfa2f996-7907-4490-84d6-c04c5d0ca6e5
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-430df990-9acf-419e-9351-7fa7ce71194c tempest-AttachVolumeShelveTestJSON-192114773 tempest-AttachVolumeShelveTestJSON-192114773-project-member] Lock "cfa2f996-7907-4490-84d6-c04c5d0ca6e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:41 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015506.8903098, 0d1c12d3-8962-49e8-8ad5-071caee70b94 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:18:41 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] VM Stopped (Lifecycle Event)
Aug 14 12:18:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6272bdb2-a1cc-4756-97f1-ff8419f2df28 None None] [instance: 0d1c12d3-8962-49e8-8ad5-071caee70b94] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:42 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:18:42 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7464MB free_disk=25.28113555908203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 722de834-9535-4249-91b3-378e4b98f8e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:18:42 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:18:43 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:18:43 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:18:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:18:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:44 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:18:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG nova.objects.instance [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'flavor' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:18:52 user nova-compute[73012]: INFO nova.compute.manager [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Attaching volume 1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 to /dev/vdb
Aug 14 12:18:52 user nova-compute[73012]: DEBUG os_brick.utils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d417cc-7baf-4790-a998-7e9a970bcc47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b520ad3-c7ba-4735-9c89-8a1aed73e90b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd186831-6719-4c51-8c99-45291868d400]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[685ae754-3809-4b15-bd17-17be63bc0971]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:18:52 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:18:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23518a6-aeef-45f4-b8d9-32e89fe2808b]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG os_brick.utils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:18:52 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updating existing volume attachment record: a291ca67-8cc3-4fc7-9613-0e264ad6100a {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:18:54 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015519.1940076, cfa2f996-7907-4490-84d6-c04c5d0ca6e5 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:18:54 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] VM Stopped (Lifecycle Event)
Aug 14 12:18:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a3be661-2d2d-46a2-b7e2-5a20cc9c37c7 None None] [instance: cfa2f996-7907-4490-84d6-c04c5d0ca6e5] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:18:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:18:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oebJwjXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:19:03 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:03 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:03 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9601bca-8746-47a0-90be-9970258f0663]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:19:03 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[79316c69-20b9-4daf-95e3-208293c00304]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64] added
Aug 14 12:19:03 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b8d7bd-f8ba-4708-9434-7a48be549220]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74a09a7-ddce-4bac-a4c5-2cd9eeff8fb0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oebJwjXI {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oebJwjXI" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c805e-9b70-439b-ac90-022a65c96999]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oebJwjXI'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdc56cb-d059-4dda-9d83-83f1b92cb00c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26a34b3-4a63-4497-aa45-d81413c5f97f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a717a112-72ce-4d0b-8461-feca310a490b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260]
Aug 14 12:19:04 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260] successful.
Aug 14 12:19:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db41497-69d4-42a7-95a6-5ed0b59748ec]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[448d8744-20ca-474c-9c9a-b39541a3162a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:04 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:04 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d9203e-c88d-406c-98fd-e0e4a6756df1]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oebJwjXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:04 user nova-compute[73012]: DEBUG nova.objects.instance [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:05 user nova-compute[73012]: INFO nova.compute.manager [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attaching volume e2692768-1625-4024-ad45-640abc2f2dc9 to /dev/vdb
Aug 14 12:19:05 user nova-compute[73012]: DEBUG os_brick.utils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26436663135303066', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436663135303066', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d25651-df4a-4149-96e1-936a78ff4346]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG nova.objects.instance [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'flavor' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c5b01f-ec59-4907-b61b-ac4a5a55089d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:19:05 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:19:05 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:19:05 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:19:05 user nova-compute[73012]:   <serial>1a4b7337-0a97-4f71-9ffd-e6efbc42bb64</serial>
Aug 14 12:19:05 user nova-compute[73012]: </disk>
Aug 14 12:19:05 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3465d721-e38d-4b3c-a644-4edda8566d28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[43114e1b-22ad-4d81-ad5f-2837b4754f3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:19:05 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e79bd-2973-4f33-aa36-f56b76793f7e]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG os_brick.utils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updating existing volume attachment record: dbf957c1-a832-42ef-baf5-2f08685e2261 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No VIF found with MAC fa:16:3e:be:2f:08, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:19:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94e8ae76-cc98-4bd4-8545-d666537ba1c1 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.231s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:19:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:19:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:19:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:19:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:19:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:20 user nova-compute[73012]: INFO nova.compute.manager [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Terminating instance
Aug 14 12:19:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-4f4207e9-acf7-4de9-83d8-56f2067f2d5c req-98f59ccd-95bb-42fe-83e5-7d7233b5b85a service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received event network-vif-unplugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f4207e9-acf7-4de9-83d8-56f2067f2d5c req-98f59ccd-95bb-42fe-83e5-7d7233b5b85a service nova] Acquiring lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f4207e9-acf7-4de9-83d8-56f2067f2d5c req-98f59ccd-95bb-42fe-83e5-7d7233b5b85a service nova] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f4207e9-acf7-4de9-83d8-56f2067f2d5c req-98f59ccd-95bb-42fe-83e5-7d7233b5b85a service nova] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-4f4207e9-acf7-4de9-83d8-56f2067f2d5c req-98f59ccd-95bb-42fe-83e5-7d7233b5b85a service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] No waiting events found dispatching network-vif-unplugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-4f4207e9-acf7-4de9-83d8-56f2067f2d5c req-98f59ccd-95bb-42fe-83e5-7d7233b5b85a service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received event network-vif-unplugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVkNoYJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:19:20 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:20 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:20 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[987cf6d0-e945-4f7e-b5bd-0343e6c3c63e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:19:20 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[679d8af2-e027-420b-80fd-11a361b640d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9] added
Aug 14 12:19:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e03deb-a3ab-4c9b-9e91-6223ce1fc8fc]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4219caf8-2355-40ea-b9ec-d10de2698036]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVkNoYJG {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVkNoYJG" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bed654-3e34-453c-9930-3c885d651313]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVkNoYJG'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b7042c-ad1b-406a-b919-08907adf0e9b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Instance destroyed successfully.
Aug 14 12:19:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lazy-loading 'resources' on Instance uuid 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-558576432',display_name='tempest-ServersNegativeTestJSON-server-558576432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-558576432',id=17,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eae6df64fbac46eeb8de845a5b22b406',ramdisk_id='',reservation_id='r-h7htq8ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-78801721',owner_user_name='tempest-ServersNegativeTestJSON-78801721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:10:33Z,user_data=None,user_id='10e35f53a2144a57ab7c200323cccbe5',uuid=95048ac7-fa1f-42ef-8cbf-f6d2eff18d37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converting VIF {"id": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "address": "fa:16:3e:df:11:64", "network": {"id": "11f73e76-42a2-4d0c-8a4d-168916f09a64", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-813995014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae6df64fbac46eeb8de845a5b22b406", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dcf669a-ca", "ovs_interfaceid": "2dcf669a-ca6c-45d3-afb8-0e014f230386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:11:64,bridge_name='br-int',has_traffic_filtering=True,id=2dcf669a-ca6c-45d3-afb8-0e014f230386,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcf669a-ca') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_vif [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:11:64,bridge_name='br-int',has_traffic_filtering=True,id=2dcf669a-ca6c-45d3-afb8-0e014f230386,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcf669a-ca') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2845088f-0745-4f33-92bf-d3fac01750b3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dcf669a-ca, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:19:21 user nova-compute[73012]: INFO os_vif [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:11:64,bridge_name='br-int',has_traffic_filtering=True,id=2dcf669a-ca6c-45d3-afb8-0e014f230386,network=Network(11f73e76-42a2-4d0c-8a4d-168916f09a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dcf669a-ca')
Aug 14 12:19:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Deleting instance files /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37_del
Aug 14 12:19:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Deletion of /opt/stack/data/nova/instances/95048ac7-fa1f-42ef-8cbf-f6d2eff18d37_del complete
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b682107a-1831-4d84-a269-1503a9e48e84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9, portal: 172.16.0.220,3260]
Aug 14 12:19:21 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9, portal: 172.16.0.220,3260] successful.
Aug 14 12:19:21 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98e87db-832c-4a38-8683-4a406c2960d1]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:21 user nova-compute[73012]: INFO nova.compute.manager [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37ee3a5-8116-453a-8b6a-cf1bb886a6b4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 (non-flash)
Aug 14 12:19:21 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4687675-1703-49c2-a1e7-b674d3177c99]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:19:21 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Took 0.65 seconds to deallocate network for instance.
Aug 14 12:19:21 user nova-compute[73012]: DEBUG nova.compute.manager [req-00f4622f-e063-41ee-9cad-874267ec741f req-307423bf-7910-4f03-9a2d-4c17f716de7c service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received event network-vif-deleted-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVkNoYJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26536656430366461', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536656430366461', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.objects.instance [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:22 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Deleted allocations for instance 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:19:22 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:19:22 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:19:22 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:19:22 user nova-compute[73012]:   <serial>e2692768-1625-4024-ad45-640abc2f2dc9</serial>
Aug 14 12:19:22 user nova-compute[73012]: </disk>
Aug 14 12:19:22 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d97edcec-5fea-4235-9805-b8bf9c922cfc tempest-ServersNegativeTestJSON-78801721 tempest-ServersNegativeTestJSON-78801721-project-member] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No VIF found with MAC fa:16:3e:2d:27:fb, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-9aca4dfc-f281-4428-83c5-444f2d938cb1 req-fcf551df-5dfe-4de6-b28b-b06b1574da71 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received event network-vif-plugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9aca4dfc-f281-4428-83c5-444f2d938cb1 req-fcf551df-5dfe-4de6-b28b-b06b1574da71 service nova] Acquiring lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9aca4dfc-f281-4428-83c5-444f2d938cb1 req-fcf551df-5dfe-4de6-b28b-b06b1574da71 service nova] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9aca4dfc-f281-4428-83c5-444f2d938cb1 req-fcf551df-5dfe-4de6-b28b-b06b1574da71 service nova] Lock "95048ac7-fa1f-42ef-8cbf-f6d2eff18d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-9aca4dfc-f281-4428-83c5-444f2d938cb1 req-fcf551df-5dfe-4de6-b28b-b06b1574da71 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] No waiting events found dispatching network-vif-plugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:22 user nova-compute[73012]: WARNING nova.compute.manager [req-9aca4dfc-f281-4428-83c5-444f2d938cb1 req-fcf551df-5dfe-4de6-b28b-b06b1574da71 service nova] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Received unexpected event network-vif-plugged-2dcf669a-ca6c-45d3-afb8-0e014f230386 for instance with vm_state deleted and task_state None.
Aug 14 12:19:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-734005fd-31e6-41d2-a8cf-5c4346cd651f tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.674s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-5349a9e5-a839-4573-b7cc-a64d1e421d9a req-2371cf34-2611-47f9-ad3a-b2288e6e6755 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-5349a9e5-a839-4573-b7cc-a64d1e421d9a req-2371cf34-2611-47f9-ad3a-b2288e6e6755 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing instance network info cache due to event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:19:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5349a9e5-a839-4573-b7cc-a64d1e421d9a req-2371cf34-2611-47f9-ad3a-b2288e6e6755 service nova] Acquiring lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:19:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5349a9e5-a839-4573-b7cc-a64d1e421d9a req-2371cf34-2611-47f9-ad3a-b2288e6e6755 service nova] Acquired lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:19:24 user nova-compute[73012]: DEBUG nova.network.neutron [req-5349a9e5-a839-4573-b7cc-a64d1e421d9a req-2371cf34-2611-47f9-ad3a-b2288e6e6755 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:25 user nova-compute[73012]: INFO nova.compute.manager [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Detaching volume e2692768-1625-4024-ad45-640abc2f2dc9
Aug 14 12:19:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-5349a9e5-a839-4573-b7cc-a64d1e421d9a req-2371cf34-2611-47f9-ad3a-b2288e6e6755 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updated VIF entry in instance network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-5349a9e5-a839-4573-b7cc-a64d1e421d9a req-2371cf34-2611-47f9-ad3a-b2288e6e6755 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updating instance_info_cache with network_info: [{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5349a9e5-a839-4573-b7cc-a64d1e421d9a req-2371cf34-2611-47f9-ad3a-b2288e6e6755 service nova] Releasing lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:19:25 user nova-compute[73012]: INFO nova.virt.block_device [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attempting to driver detach volume e2692768-1625-4024-ad45-640abc2f2dc9 from mountpoint /dev/vdb
Aug 14 12:19:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Attempting to detach device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:19:25 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:19:25 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:19:25 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:19:25 user nova-compute[73012]:   <serial>e2692768-1625-4024-ad45-640abc2f2dc9</serial>
Aug 14 12:19:25 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:19:25 user nova-compute[73012]: </disk>
Aug 14 12:19:25 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:25 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully detached device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the persistent domain config.
Aug 14 12:19:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:19:25 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:19:25 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:19:25 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:19:25 user nova-compute[73012]:   <serial>e2692768-1625-4024-ad45-640abc2f2dc9</serial>
Aug 14 12:19:25 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:19:25 user nova-compute[73012]: </disk>
Aug 14 12:19:25 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015565.9166036, 8e51a9ce-cd61-4c43-a297-7f313bf2a07c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:19:25 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully detached device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the live domain config.
Aug 14 12:19:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVkNoYJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:19:25 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[42764ef5-add4-4334-9ab1-b9d2bdc4166d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d53e2fe-43fe-4035-a65f-efe3bbc64130]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:25 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:25 user nova-compute[73012]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 (non-flash)
Aug 14 12:19:25 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:25 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:25 user nova-compute[73012]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 (non-flash)
Aug 14 12:19:25 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad05c4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:19:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d2e719-39ec-40a3-8952-b9b7641570f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc0800-7a9a-4145-b4ad-c898b36af08b]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[913bce92-4f76-4303-84a0-14c6ac50bb33]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b63c615-8eec-4ef1-8179-fc9109ced176]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f5b622-bbcb-4415-8544-e58c49a3e186]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[28335389-efe0-46ec-b7cb-9cb90934632c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9, portal: 172.16.0.220,3260]
Aug 14 12:19:26 user nova-compute[73012]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9, portal: 172.16.0.220,3260] successful.
Aug 14 12:19:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2692768-1625-4024-ad45-640abc2f2dc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.094s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0316b2-e841-4fee-a45e-2307d4b83ebe]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== disconnect_volume: return (348ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-91ae7868-d445-4f19-a19f-bb976389034e req-367f72f6-3400-4572-8af1-3858ab23a619 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-91ae7868-d445-4f19-a19f-bb976389034e req-367f72f6-3400-4572-8af1-3858ab23a619 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing instance network info cache due to event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-91ae7868-d445-4f19-a19f-bb976389034e req-367f72f6-3400-4572-8af1-3858ab23a619 service nova] Acquiring lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-91ae7868-d445-4f19-a19f-bb976389034e req-367f72f6-3400-4572-8af1-3858ab23a619 service nova] Acquired lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:19:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-91ae7868-d445-4f19-a19f-bb976389034e req-367f72f6-3400-4572-8af1-3858ab23a619 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:19:27 user nova-compute[73012]: DEBUG nova.network.neutron [req-91ae7868-d445-4f19-a19f-bb976389034e req-367f72f6-3400-4572-8af1-3858ab23a619 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updated VIF entry in instance network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:19:27 user nova-compute[73012]: DEBUG nova.network.neutron [req-91ae7868-d445-4f19-a19f-bb976389034e req-367f72f6-3400-4572-8af1-3858ab23a619 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updating instance_info_cache with network_info: [{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:19:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-91ae7868-d445-4f19-a19f-bb976389034e req-367f72f6-3400-4572-8af1-3858ab23a619 service nova] Releasing lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:19:27 user nova-compute[73012]: DEBUG nova.objects.instance [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-02db0b99-aaca-440c-ac0b-7afb2592556a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.935s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:32 user nova-compute[73012]: INFO nova.compute.manager [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Rebooting instance
Aug 14 12:19:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:19:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquired lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:19:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updating instance_info_cache with network_info: [{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Releasing lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-11256923-e5ed-4837-a327-9abba52e7822 req-6477d8b5-896a-464d-9562-1d50dc0fa91d service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-unplugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-11256923-e5ed-4837-a327-9abba52e7822 req-6477d8b5-896a-464d-9562-1d50dc0fa91d service nova] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-11256923-e5ed-4837-a327-9abba52e7822 req-6477d8b5-896a-464d-9562-1d50dc0fa91d service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-11256923-e5ed-4837-a327-9abba52e7822 req-6477d8b5-896a-464d-9562-1d50dc0fa91d service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-11256923-e5ed-4837-a327-9abba52e7822 req-6477d8b5-896a-464d-9562-1d50dc0fa91d service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] No waiting events found dispatching network-vif-unplugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:33 user nova-compute[73012]: WARNING nova.compute.manager [req-11256923-e5ed-4837-a327-9abba52e7822 req-6477d8b5-896a-464d-9562-1d50dc0fa91d service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received unexpected event network-vif-unplugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 12:19:34 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Instance destroyed successfully.
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.objects.instance [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'resources' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2090819762',display_name='tempest-TestMinimumBasicScenario-server-2090819762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2090819762',id=27,image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/1P1r7AreTvEXXZhLTnEfr4e7XilrWGHn6/JEAVreeRFnynkXIX9PgsUZ+6qb9djMhPUPTX1LoegbIFijSORdeYf9w55P6fR3mWAuq6XBGe8VbYr5eZI8r1npC31ylAA==',key_name='tempest-TestMinimumBasicScenario-884270579',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3be304f15a542fc98ed7614001dd016',ramdisk_id='',reservation_id='r-brsox2q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1379939828',owner_user_name='tempest-TestMinimumBasicScenario-1379939828-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:19:33Z,user_data=None,user_id='0f89f51cc15e4ffb8860f42ddcb44ae1',uuid=722de834-9535-4249-91b3-378e4b98f8e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converting VIF {"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_vif [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0ba563f-c8, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:19:34 user nova-compute[73012]: INFO os_vif [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8')
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oebJwjXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:19:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f9993-5850-411d-b3f4-1ad7ba201aab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d09fff-e339-40bc-a3d3-2c296ae61204]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:34 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:34 user nova-compute[73012]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad05c5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbab753-e832-46d2-82b4-a42faa8190dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7676fd-7e62-4c35-9bdf-8a1e1e9c7a0c]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bca2f7-a3b9-4126-b5c2-c856fbef4e98]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fa3ab1-c72c-4521-91a3-1fe1e6876058]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf176eb9-2f95-441d-b1f4-10c6136b68ba]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf101df4-2f0b-4cd8-900b-00e80c1cec46]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260]
Aug 14 12:19:34 user nova-compute[73012]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260] successful.
Aug 14 12:19:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14dccf2-8819-4cfd-8947-13978ee28175]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] <== disconnect_volume: return (271ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Start _get_guest_xml network_info=[{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a251c3cc-bd85-4597-9c67-c0b98d2f6b2f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'a251c3cc-bd85-4597-9c67-c0b98d2f6b2f'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oebJwjXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '722de834-9535-4249-91b3-378e4b98f8e0', 'attached_at': '', 'detached_at': '', 'volume_id': '1a4b7337-0a97-4f71-9ffd-e6efbc42bb64', 'serial': '1a4b7337-0a97-4f71-9ffd-e6efbc42bb64'}, 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'a291ca67-8cc3-4fc7-9613-0e264ad6100a', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:19:34 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:19:34 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a251c3cc-bd85-4597-9c67-c0b98d2f6b2f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.objects.instance [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oebJwjXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:19:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:34 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2cd39f-10aa-4677-91df-899a6358f6eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:19:34 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[31273f45-8088-4bc5-b5fa-c62cfed2b60f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64] added
Aug 14 12:19:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[df88e4fb-7a8e-41ff-9bfc-7bffd6972638]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d0420f-4b8b-4e4f-a9c2-4cf6b76fd525]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oebJwjXI {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oebJwjXI" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d198a14b-9af1-444b-8ff3-509b7aad3384]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oebJwjXI'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[92da7acd-d171-4f13-b058-9a63e832fee1]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[110de590-673b-4f90-a23d-15bf5ff2a2d6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa6f65-5812-4499-9075-b614d17989b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260]
Aug 14 12:19:35 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260] successful.
Aug 14 12:19:35 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[92493283-b359-4563-86fd-7bca54e28764]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7e6609-e503-4217-aead-e68286711b66]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:35 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:35 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:35 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:35 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8fc1c1-441e-4d84-8cf7-bfb3272d231d]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oebJwjXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-9a2b2e7f-cc56-4513-ba85-fddd9524f46b req-e5356d90-71a3-4f19-bea0-661f6590d0a9 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9a2b2e7f-cc56-4513-ba85-fddd9524f46b req-e5356d90-71a3-4f19-bea0-661f6590d0a9 service nova] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9a2b2e7f-cc56-4513-ba85-fddd9524f46b req-e5356d90-71a3-4f19-bea0-661f6590d0a9 service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9a2b2e7f-cc56-4513-ba85-fddd9524f46b req-e5356d90-71a3-4f19-bea0-661f6590d0a9 service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-9a2b2e7f-cc56-4513-ba85-fddd9524f46b req-e5356d90-71a3-4f19-bea0-661f6590d0a9 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] No waiting events found dispatching network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:35 user nova-compute[73012]: WARNING nova.compute.manager [req-9a2b2e7f-cc56-4513-ba85-fddd9524f46b req-e5356d90-71a3-4f19-bea0-661f6590d0a9 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received unexpected event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015561.0005014, 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:19:36 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] VM Stopped (Lifecycle Event)
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-43ce0214-f7f6-4316-b6a7-5a2867adaad4 None None] [instance: 95048ac7-fa1f-42ef-8cbf-f6d2eff18d37] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26436663135303066', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436663135303066', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2090819762',display_name='tempest-TestMinimumBasicScenario-server-2090819762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2090819762',id=27,image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/1P1r7AreTvEXXZhLTnEfr4e7XilrWGHn6/JEAVreeRFnynkXIX9PgsUZ+6qb9djMhPUPTX1LoegbIFijSORdeYf9w55P6fR3mWAuq6XBGe8VbYr5eZI8r1npC31ylAA==',key_name='tempest-TestMinimumBasicScenario-884270579',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3be304f15a542fc98ed7614001dd016',ramdisk_id='',reservation_id='r-brsox2q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1379939828',owner_user_name='tempest-TestMinimumBasicScenario-1379939828-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:19:33Z,user_data=None,user_id='0f89f51cc15e4ffb8860f42ddcb44ae1',uuid=722de834-9535-4249-91b3-378e4b98f8e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converting VIF {"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'pci_devices' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:19:36 user nova-compute[73012]:   <uuid>722de834-9535-4249-91b3-378e4b98f8e0</uuid>
Aug 14 12:19:36 user nova-compute[73012]:   <name>instance-0000001b</name>
Aug 14 12:19:36 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:19:36 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:19:36 user nova-compute[73012]:   <metadata>
Aug 14 12:19:36 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:19:36 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:19:36 user nova-compute[73012]:       <nova:name>tempest-TestMinimumBasicScenario-server-2090819762</nova:name>
Aug 14 12:19:36 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:19:34</nova:creationTime>
Aug 14 12:19:36 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:19:36 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:19:36 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:19:36 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:19:36 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:19:36 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:19:36 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:19:36 user nova-compute[73012]:       <nova:owner>
Aug 14 12:19:36 user nova-compute[73012]:         <nova:user uuid="0f89f51cc15e4ffb8860f42ddcb44ae1">tempest-TestMinimumBasicScenario-1379939828-project-member</nova:user>
Aug 14 12:19:36 user nova-compute[73012]:         <nova:project uuid="b3be304f15a542fc98ed7614001dd016">tempest-TestMinimumBasicScenario-1379939828</nova:project>
Aug 14 12:19:36 user nova-compute[73012]:       </nova:owner>
Aug 14 12:19:36 user nova-compute[73012]:       <nova:root type="image" uuid="a251c3cc-bd85-4597-9c67-c0b98d2f6b2f"/>
Aug 14 12:19:36 user nova-compute[73012]:       <nova:ports>
Aug 14 12:19:36 user nova-compute[73012]:         <nova:port uuid="e0ba563f-c8ca-48c4-8954-be7f64edde26">
Aug 14 12:19:36 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 12:19:36 user nova-compute[73012]:         </nova:port>
Aug 14 12:19:36 user nova-compute[73012]:       </nova:ports>
Aug 14 12:19:36 user nova-compute[73012]:     </nova:instance>
Aug 14 12:19:36 user nova-compute[73012]:   </metadata>
Aug 14 12:19:36 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:19:36 user nova-compute[73012]:     <system>
Aug 14 12:19:36 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:19:36 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:19:36 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:19:36 user nova-compute[73012]:       <entry name="serial">722de834-9535-4249-91b3-378e4b98f8e0</entry>
Aug 14 12:19:36 user nova-compute[73012]:       <entry name="uuid">722de834-9535-4249-91b3-378e4b98f8e0</entry>
Aug 14 12:19:36 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:19:36 user nova-compute[73012]:     </system>
Aug 14 12:19:36 user nova-compute[73012]:   </sysinfo>
Aug 14 12:19:36 user nova-compute[73012]:   <os>
Aug 14 12:19:36 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:19:36 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:19:36 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:19:36 user nova-compute[73012]:   </os>
Aug 14 12:19:36 user nova-compute[73012]:   <features>
Aug 14 12:19:36 user nova-compute[73012]:     <acpi/>
Aug 14 12:19:36 user nova-compute[73012]:     <apic/>
Aug 14 12:19:36 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:19:36 user nova-compute[73012]:   </features>
Aug 14 12:19:36 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:19:36 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:19:36 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:19:36 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:19:36 user nova-compute[73012]:   </clock>
Aug 14 12:19:36 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:19:36 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:19:36 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:19:36 user nova-compute[73012]:   </cpu>
Aug 14 12:19:36 user nova-compute[73012]:   <devices>
Aug 14 12:19:36 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:19:36 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:19:36 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk"/>
Aug 14 12:19:36 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:19:36 user nova-compute[73012]:     </disk>
Aug 14 12:19:36 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:19:36 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:19:36 user nova-compute[73012]:       <source dev="/dev/sdc"/>
Aug 14 12:19:36 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:19:36 user nova-compute[73012]:       <serial>1a4b7337-0a97-4f71-9ffd-e6efbc42bb64</serial>
Aug 14 12:19:36 user nova-compute[73012]:     </disk>
Aug 14 12:19:36 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:19:36 user nova-compute[73012]:       <mac address="fa:16:3e:be:2f:08"/>
Aug 14 12:19:36 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:19:36 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:19:36 user nova-compute[73012]:       <target dev="tape0ba563f-c8"/>
Aug 14 12:19:36 user nova-compute[73012]:     </interface>
Aug 14 12:19:36 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:19:36 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/console.log" append="off"/>
Aug 14 12:19:36 user nova-compute[73012]:     </serial>
Aug 14 12:19:36 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:19:36 user nova-compute[73012]:     <video>
Aug 14 12:19:36 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:19:36 user nova-compute[73012]:     </video>
Aug 14 12:19:36 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:19:36 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:19:36 user nova-compute[73012]:     </rng>
Aug 14 12:19:36 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:19:36 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:19:36 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:19:36 user nova-compute[73012]:     </memballoon>
Aug 14 12:19:36 user nova-compute[73012]:   </devices>
Aug 14 12:19:36 user nova-compute[73012]: </domain>
Aug 14 12:19:36 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'trusted_certs' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34 --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Cannot resize image /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'migration_context' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2090819762',display_name='tempest-TestMinimumBasicScenario-server-2090819762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2090819762',id=27,image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/1P1r7AreTvEXXZhLTnEfr4e7XilrWGHn6/JEAVreeRFnynkXIX9PgsUZ+6qb9djMhPUPTX1LoegbIFijSORdeYf9w55P6fR3mWAuq6XBGe8VbYr5eZI8r1npC31ylAA==',key_name='tempest-TestMinimumBasicScenario-884270579',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b3be304f15a542fc98ed7614001dd016',ramdisk_id='',reservation_id='r-brsox2q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1379939828',owner_user_name='tempest-TestMinimumBasicScenario-1379939828-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:19:33Z,user_data=None,user_id='0f89f51cc15e4ffb8860f42ddcb44ae1',uuid=722de834-9535-4249-91b3-378e4b98f8e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converting VIF {"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG os_vif [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0ba563f-c8, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0ba563f-c8, col_values=(('external_ids', {'iface-id': 'e0ba563f-c8ca-48c4-8954-be7f64edde26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:2f:08', 'vm-uuid': '722de834-9535-4249-91b3-378e4b98f8e0'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:19:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:36 user nova-compute[73012]: INFO os_vif [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8')
Aug 14 12:19:37 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:37 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-98b13e77-e7de-4a64-abad-30a723492290 req-e948edea-2367-4474-8c42-4e029ce01b51 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-98b13e77-e7de-4a64-abad-30a723492290 req-e948edea-2367-4474-8c42-4e029ce01b51 service nova] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-98b13e77-e7de-4a64-abad-30a723492290 req-e948edea-2367-4474-8c42-4e029ce01b51 service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-98b13e77-e7de-4a64-abad-30a723492290 req-e948edea-2367-4474-8c42-4e029ce01b51 service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-98b13e77-e7de-4a64-abad-30a723492290 req-e948edea-2367-4474-8c42-4e029ce01b51 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] No waiting events found dispatching network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:38 user nova-compute[73012]: WARNING nova.compute.manager [req-98b13e77-e7de-4a64-abad-30a723492290 req-e948edea-2367-4474-8c42-4e029ce01b51 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received unexpected event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 12:19:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for 722de834-9535-4249-91b3-378e4b98f8e0 due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015580.508999, 722de834-9535-4249-91b3-378e4b98f8e0 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:19:40 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] VM Resumed (Lifecycle Event)
Aug 14 12:19:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Instance rebooted successfully.
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:19:40 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015580.5095518, 722de834-9535-4249-91b3-378e4b98f8e0 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:19:40 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] VM Started (Lifecycle Event)
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-533e38e3-04f9-40ff-914b-9da3db966e09 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.878s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-238ee613-d403-4f5a-85b7-e35fa88f211b req-eec63776-acb2-4832-942a-3c495b140d89 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-238ee613-d403-4f5a-85b7-e35fa88f211b req-eec63776-acb2-4832-942a-3c495b140d89 service nova] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-238ee613-d403-4f5a-85b7-e35fa88f211b req-eec63776-acb2-4832-942a-3c495b140d89 service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-238ee613-d403-4f5a-85b7-e35fa88f211b req-eec63776-acb2-4832-942a-3c495b140d89 service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-238ee613-d403-4f5a-85b7-e35fa88f211b req-eec63776-acb2-4832-942a-3c495b140d89 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] No waiting events found dispatching network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:40 user nova-compute[73012]: WARNING nova.compute.manager [req-238ee613-d403-4f5a-85b7-e35fa88f211b req-eec63776-acb2-4832-942a-3c495b140d89 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received unexpected event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 for instance with vm_state active and task_state None.
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:19:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:43 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:19:43 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7840MB free_disk=25.323814392089844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 722de834-9535-4249-91b3-378e4b98f8e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:19:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:44 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:19:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:19:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:19:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Updating instance_info_cache with network_info: [{"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-dac504e0-6795-415f-9258-fce197362852 req-d43b7587-836b-417a-84d5-60bc3aefb8da service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-changed-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-dac504e0-6795-415f-9258-fce197362852 req-d43b7587-836b-417a-84d5-60bc3aefb8da service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Refreshing instance network info cache due to event network-changed-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dac504e0-6795-415f-9258-fce197362852 req-d43b7587-836b-417a-84d5-60bc3aefb8da service nova] Acquiring lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dac504e0-6795-415f-9258-fce197362852 req-d43b7587-836b-417a-84d5-60bc3aefb8da service nova] Acquired lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:19:45 user nova-compute[73012]: DEBUG nova.network.neutron [req-dac504e0-6795-415f-9258-fce197362852 req-d43b7587-836b-417a-84d5-60bc3aefb8da service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Refreshing network info cache for port 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'flavor' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:46 user nova-compute[73012]: INFO nova.compute.manager [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Attaching volume c44c073a-8324-434f-9e9b-f2e467db3867 to /dev/vdb
Aug 14 12:19:46 user nova-compute[73012]: DEBUG nova.network.neutron [req-dac504e0-6795-415f-9258-fce197362852 req-d43b7587-836b-417a-84d5-60bc3aefb8da service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updated VIF entry in instance network info cache for port 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG nova.network.neutron [req-dac504e0-6795-415f-9258-fce197362852 req-d43b7587-836b-417a-84d5-60bc3aefb8da service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updating instance_info_cache with network_info: [{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-dac504e0-6795-415f-9258-fce197362852 req-d43b7587-836b-417a-84d5-60bc3aefb8da service nova] Releasing lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG os_brick.utils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff3d8d7-aa6b-4059-a4b2-9ff02e917040]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1af891c-809e-4c07-b40d-0b2d5aba6845]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[202f1ae7-e16a-4d27-90cb-c94b5b559f71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ddbf3-64da-4cbe-a1fc-ff3f1e4ec42b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:19:46 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:19:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4af4d21-eff1-4ace-8ef7-80086f85975a]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG os_brick.utils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updating existing volume attachment record: cca53718-4bb4-4bfd-8169-17e5714f814e {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:19:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:47 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:19:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:51 user nova-compute[73012]: INFO nova.compute.manager [None req-045cee32-eead-4e5e-ac94-d2cea43b1923 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Unrescuing
Aug 14 12:19:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-045cee32-eead-4e5e-ac94-d2cea43b1923 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:19:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-045cee32-eead-4e5e-ac94-d2cea43b1923 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquired lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:19:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-045cee32-eead-4e5e-ac94-d2cea43b1923 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:19:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG nova.network.neutron [None req-045cee32-eead-4e5e-ac94-d2cea43b1923 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updating instance_info_cache with network_info: [{"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-045cee32-eead-4e5e-ac94-d2cea43b1923 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Releasing lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG nova.objects.instance [None req-045cee32-eead-4e5e-ac94-d2cea43b1923 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'flavor' on Instance uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-e45f4986-4e5a-41b1-b3ab-788454d6f298 req-b80e0973-8a91-40a4-9969-0e30b1b74ebe service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e45f4986-4e5a-41b1-b3ab-788454d6f298 req-b80e0973-8a91-40a4-9969-0e30b1b74ebe service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e45f4986-4e5a-41b1-b3ab-788454d6f298 req-b80e0973-8a91-40a4-9969-0e30b1b74ebe service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e45f4986-4e5a-41b1-b3ab-788454d6f298 req-b80e0973-8a91-40a4-9969-0e30b1b74ebe service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-e45f4986-4e5a-41b1-b3ab-788454d6f298 req-b80e0973-8a91-40a4-9969-0e30b1b74ebe service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:52 user nova-compute[73012]: WARNING nova.compute.manager [req-e45f4986-4e5a-41b1-b3ab-788454d6f298 req-b80e0973-8a91-40a4-9969-0e30b1b74ebe service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:19:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:53 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Instance destroyed successfully.
Aug 14 12:19:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-f7048986-7767-4af7-9f69-83eabfee4d5f req-402fcca7-d33b-4ca6-8415-6ad036aab975 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f7048986-7767-4af7-9f69-83eabfee4d5f req-402fcca7-d33b-4ca6-8415-6ad036aab975 service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f7048986-7767-4af7-9f69-83eabfee4d5f req-402fcca7-d33b-4ca6-8415-6ad036aab975 service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f7048986-7767-4af7-9f69-83eabfee4d5f req-402fcca7-d33b-4ca6-8415-6ad036aab975 service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-f7048986-7767-4af7-9f69-83eabfee4d5f req-402fcca7-d33b-4ca6-8415-6ad036aab975 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:54 user nova-compute[73012]: WARNING nova.compute.manager [req-f7048986-7767-4af7-9f69-83eabfee4d5f req-402fcca7-d33b-4ca6-8415-6ad036aab975 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:19:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deYWGkiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:19:56 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:56 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:19:56 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[81028b79-d17d-4e4e-8162-f75d089d1cd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:19:56 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e641b4-2f31-4a88-a1ac-2203a4c773bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867] added
Aug 14 12:19:56 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a00c1b3-850b-4e09-b21a-b7256f4dad67]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b095e5cf-1ede-4571-b9fc-5f54c73f9fd3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deYWGkiO {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deYWGkiO" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dd3c60-fb18-4a32-b847-ea1e62beca86]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'deYWGkiO'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b35caa7-b9b6-49c7-9730-f9a0d91d2d7b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[09605674-58f2-402b-a912-9710c1b2a6f6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c81cc47-0e83-44f7-9fa4-d70b885cea51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867, portal: 172.16.0.220,3260]
Aug 14 12:19:56 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867, portal: 172.16.0.220,3260] successful.
Aug 14 12:19:56 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6761463-2abd-49fd-b137-f2a915f876a1]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4e2b5f-c176-4b4b-a1c3-f857da449249]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:19:56 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[11196eba-84b6-4c47-bc2a-1ae48bb6e177]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:56 user nova-compute[73012]: WARNING nova.compute.manager [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:19:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:19:56 user nova-compute[73012]: WARNING nova.compute.manager [req-12572578-c16f-4f3f-a098-84fba9e599f2 req-75763e50-392f-423e-8017-a8fc176154ca service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:19:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for 4f831e0c-5249-461a-a00a-484c59da5a8a due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015597.0071344, 4f831e0c-5249-461a-a00a-484c59da5a8a => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:19:57 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] VM Resumed (Lifecycle Event)
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-045cee32-eead-4e5e-ac94-d2cea43b1923 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:19:57 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015597.011586, 4f831e0c-5249-461a-a00a-484c59da5a8a => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:19:57 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] VM Started (Lifecycle Event)
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deYWGkiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23766633031393166', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766633031393166', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'flavor' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:19:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:19:57 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:19:57 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:19:57 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:19:57 user nova-compute[73012]:   <serial>c44c073a-8324-434f-9e9b-f2e467db3867</serial>
Aug 14 12:19:57 user nova-compute[73012]: </disk>
Aug 14 12:19:57 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:19:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:19:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:19:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No VIF found with MAC fa:16:3e:6a:de:c7, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:19:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e2dc9df1-b242-487c-8edd-37e5015f11c8 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.897s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:58 user nova-compute[73012]: INFO nova.compute.manager [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Rescuing
Aug 14 12:19:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:19:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquired lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:19:58 user nova-compute[73012]: DEBUG nova.network.neutron [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updating instance_info_cache with network_info: [{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Releasing lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:19:59 user nova-compute[73012]: INFO nova.compute.claims [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Claim successful on node user
Aug 14 12:19:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:19:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.policy [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa2eccd1b9c54304aa336bfb3361b782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacdb90792d24af296884a7af3d8b1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:19:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Creating image(s)
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "/opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "/opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "/opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:19:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Instance destroyed successfully.
Aug 14 12:20:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Attempting rescue
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73012) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Instance directory exists: not creating {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 12:20:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Creating image(s)
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.221s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue" returned: 0 in 0.049s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'migration_context' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.213s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Start _get_guest_xml network_info=[{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "vif_mac": "fa:16:3e:6a:de:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'resources' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'numa_topology' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:00 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:20:00 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1359014402',display_name='tempest-ServerRescueNegativeTestJSON-server-1359014402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1359014402',id=28,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCokD7dXCKAM145fVpuWRhcuXCdxQNaK+YpOqywGLUbdT2cmO+aiYIjn4YEGVfFxlYEUhlqQSZ8T5sIoNQgJF2f1ynoY+lLYv/aWuCkYd7uVSy6jO7Hs3fUaQ0OKHNtz5Q==',key_name='tempest-keypair-737251042',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-fjrz43xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7128922092841c49b475af30075e458',uuid=73fcc85e-48fd-486b-bda8-61d834d8cb42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "vif_mac": "fa:16:3e:6a:de:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "vif_mac": "fa:16:3e:6a:de:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:de:c7,bridge_name='br-int',has_traffic_filtering=True,id=3f6a975d-16fc-4ff6-aa5a-f8255e577b7f,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6a975d-16') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'pci_devices' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:20:00 user nova-compute[73012]:   <uuid>73fcc85e-48fd-486b-bda8-61d834d8cb42</uuid>
Aug 14 12:20:00 user nova-compute[73012]:   <name>instance-0000001c</name>
Aug 14 12:20:00 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:20:00 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:20:00 user nova-compute[73012]:   <metadata>
Aug 14 12:20:00 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:20:00 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:20:00 user nova-compute[73012]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1359014402</nova:name>
Aug 14 12:20:00 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:20:00</nova:creationTime>
Aug 14 12:20:00 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:20:00 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:20:00 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:20:00 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:20:00 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:20:00 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:20:00 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:20:00 user nova-compute[73012]:       <nova:owner>
Aug 14 12:20:00 user nova-compute[73012]:         <nova:user uuid="e7128922092841c49b475af30075e458">tempest-ServerRescueNegativeTestJSON-334705254-project-member</nova:user>
Aug 14 12:20:00 user nova-compute[73012]:         <nova:project uuid="96ac2852176e4d7580080e2320371fe8">tempest-ServerRescueNegativeTestJSON-334705254</nova:project>
Aug 14 12:20:00 user nova-compute[73012]:       </nova:owner>
Aug 14 12:20:00 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:20:00 user nova-compute[73012]:       <nova:ports>
Aug 14 12:20:00 user nova-compute[73012]:         <nova:port uuid="3f6a975d-16fc-4ff6-aa5a-f8255e577b7f">
Aug 14 12:20:00 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:20:00 user nova-compute[73012]:         </nova:port>
Aug 14 12:20:00 user nova-compute[73012]:       </nova:ports>
Aug 14 12:20:00 user nova-compute[73012]:     </nova:instance>
Aug 14 12:20:00 user nova-compute[73012]:   </metadata>
Aug 14 12:20:00 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:20:00 user nova-compute[73012]:     <system>
Aug 14 12:20:00 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:20:00 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:20:00 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:20:00 user nova-compute[73012]:       <entry name="serial">73fcc85e-48fd-486b-bda8-61d834d8cb42</entry>
Aug 14 12:20:00 user nova-compute[73012]:       <entry name="uuid">73fcc85e-48fd-486b-bda8-61d834d8cb42</entry>
Aug 14 12:20:00 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:20:00 user nova-compute[73012]:     </system>
Aug 14 12:20:00 user nova-compute[73012]:   </sysinfo>
Aug 14 12:20:00 user nova-compute[73012]:   <os>
Aug 14 12:20:00 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:20:00 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:20:00 user nova-compute[73012]:   </os>
Aug 14 12:20:00 user nova-compute[73012]:   <features>
Aug 14 12:20:00 user nova-compute[73012]:     <acpi/>
Aug 14 12:20:00 user nova-compute[73012]:     <apic/>
Aug 14 12:20:00 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:20:00 user nova-compute[73012]:   </features>
Aug 14 12:20:00 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:20:00 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:20:00 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:20:00 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:20:00 user nova-compute[73012]:   </clock>
Aug 14 12:20:00 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:20:00 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:20:00 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:20:00 user nova-compute[73012]:   </cpu>
Aug 14 12:20:00 user nova-compute[73012]:   <devices>
Aug 14 12:20:00 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:20:00 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:20:00 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue"/>
Aug 14 12:20:00 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:20:00 user nova-compute[73012]:     </disk>
Aug 14 12:20:00 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:20:00 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:20:00 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk"/>
Aug 14 12:20:00 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:20:00 user nova-compute[73012]:     </disk>
Aug 14 12:20:00 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:20:00 user nova-compute[73012]:       <mac address="fa:16:3e:6a:de:c7"/>
Aug 14 12:20:00 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:20:00 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:20:00 user nova-compute[73012]:       <target dev="tap3f6a975d-16"/>
Aug 14 12:20:00 user nova-compute[73012]:     </interface>
Aug 14 12:20:00 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:20:00 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/console.log" append="off"/>
Aug 14 12:20:00 user nova-compute[73012]:     </serial>
Aug 14 12:20:00 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:20:00 user nova-compute[73012]:     <video>
Aug 14 12:20:00 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:20:00 user nova-compute[73012]:     </video>
Aug 14 12:20:00 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:20:00 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:20:00 user nova-compute[73012]:     </rng>
Aug 14 12:20:00 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:20:00 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:20:00 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:20:00 user nova-compute[73012]:     </memballoon>
Aug 14 12:20:00 user nova-compute[73012]:   </devices>
Aug 14 12:20:00 user nova-compute[73012]: </domain>
Aug 14 12:20:00 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Instance destroyed successfully.
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk 1073741824" returned: 0 in 0.054s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] No VIF found with MAC fa:16:3e:6a:de:c7, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Successfully created port: de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Cannot resize image /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'migration_context' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Ensure instance console log exists: /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Successfully updated port: de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquired lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-da10ff7f-18d6-4387-a3a6-9cee1279f596 req-d437bc37-2389-4bda-800f-cd8968a0171e service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-changed-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-da10ff7f-18d6-4387-a3a6-9cee1279f596 req-d437bc37-2389-4bda-800f-cd8968a0171e service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Refreshing instance network info cache due to event network-changed-de12db03-2755-471c-85d9-99fc6d4a0092. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-da10ff7f-18d6-4387-a3a6-9cee1279f596 req-d437bc37-2389-4bda-800f-cd8968a0171e service nova] Acquiring lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updating instance_info_cache with network_info: [{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Releasing lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance network_info: |[{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-da10ff7f-18d6-4387-a3a6-9cee1279f596 req-d437bc37-2389-4bda-800f-cd8968a0171e service nova] Acquired lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-da10ff7f-18d6-4387-a3a6-9cee1279f596 req-d437bc37-2389-4bda-800f-cd8968a0171e service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Refreshing network info cache for port de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:20:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Start _get_guest_xml network_info=[{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:20:02 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:20:02 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2032924741',display_name='tempest-AttachVolumeTestJSON-server-2032924741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2032924741',id=29,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI1LgcrTTw70xOoqnvcVDZtsOJhtmBHzQ19Oa/Uqxd3iuk4bkU5QYp2T1jIxwdRxvJI5QFQbqNJLL7XrstdskKAdhSkVcP7b1pJ7XBEdXgRVkMSdfZifb7EmSSsystmLA==',key_name='tempest-keypair-943368399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-7htr0z6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:20:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=56391331-dd5f-4641-8208-72ba5cd514a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'pci_devices' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:20:02 user nova-compute[73012]:   <uuid>56391331-dd5f-4641-8208-72ba5cd514a4</uuid>
Aug 14 12:20:02 user nova-compute[73012]:   <name>instance-0000001d</name>
Aug 14 12:20:02 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:20:02 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:20:02 user nova-compute[73012]:   <metadata>
Aug 14 12:20:02 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:20:02 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:20:02 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeTestJSON-server-2032924741</nova:name>
Aug 14 12:20:02 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:20:02</nova:creationTime>
Aug 14 12:20:02 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:20:02 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:20:02 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:20:02 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:20:02 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:20:02 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:20:02 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:20:02 user nova-compute[73012]:       <nova:owner>
Aug 14 12:20:02 user nova-compute[73012]:         <nova:user uuid="aa2eccd1b9c54304aa336bfb3361b782">tempest-AttachVolumeTestJSON-236615257-project-member</nova:user>
Aug 14 12:20:02 user nova-compute[73012]:         <nova:project uuid="cacdb90792d24af296884a7af3d8b1c6">tempest-AttachVolumeTestJSON-236615257</nova:project>
Aug 14 12:20:02 user nova-compute[73012]:       </nova:owner>
Aug 14 12:20:02 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:20:02 user nova-compute[73012]:       <nova:ports>
Aug 14 12:20:02 user nova-compute[73012]:         <nova:port uuid="de12db03-2755-471c-85d9-99fc6d4a0092">
Aug 14 12:20:02 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:20:02 user nova-compute[73012]:         </nova:port>
Aug 14 12:20:02 user nova-compute[73012]:       </nova:ports>
Aug 14 12:20:02 user nova-compute[73012]:     </nova:instance>
Aug 14 12:20:02 user nova-compute[73012]:   </metadata>
Aug 14 12:20:02 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:20:02 user nova-compute[73012]:     <system>
Aug 14 12:20:02 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:20:02 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:20:02 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:20:02 user nova-compute[73012]:       <entry name="serial">56391331-dd5f-4641-8208-72ba5cd514a4</entry>
Aug 14 12:20:02 user nova-compute[73012]:       <entry name="uuid">56391331-dd5f-4641-8208-72ba5cd514a4</entry>
Aug 14 12:20:02 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:20:02 user nova-compute[73012]:     </system>
Aug 14 12:20:02 user nova-compute[73012]:   </sysinfo>
Aug 14 12:20:02 user nova-compute[73012]:   <os>
Aug 14 12:20:02 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:20:02 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:20:02 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:20:02 user nova-compute[73012]:   </os>
Aug 14 12:20:02 user nova-compute[73012]:   <features>
Aug 14 12:20:02 user nova-compute[73012]:     <acpi/>
Aug 14 12:20:02 user nova-compute[73012]:     <apic/>
Aug 14 12:20:02 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:20:02 user nova-compute[73012]:   </features>
Aug 14 12:20:02 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:20:02 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:20:02 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:20:02 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:20:02 user nova-compute[73012]:   </clock>
Aug 14 12:20:02 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:20:02 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:20:02 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:20:02 user nova-compute[73012]:   </cpu>
Aug 14 12:20:02 user nova-compute[73012]:   <devices>
Aug 14 12:20:02 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:20:02 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:20:02 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk"/>
Aug 14 12:20:02 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:20:02 user nova-compute[73012]:     </disk>
Aug 14 12:20:02 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:20:02 user nova-compute[73012]:       <mac address="fa:16:3e:08:4b:33"/>
Aug 14 12:20:02 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:20:02 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:20:02 user nova-compute[73012]:       <target dev="tapde12db03-27"/>
Aug 14 12:20:02 user nova-compute[73012]:     </interface>
Aug 14 12:20:02 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:20:02 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/console.log" append="off"/>
Aug 14 12:20:02 user nova-compute[73012]:     </serial>
Aug 14 12:20:02 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:20:02 user nova-compute[73012]:     <video>
Aug 14 12:20:02 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:20:02 user nova-compute[73012]:     </video>
Aug 14 12:20:02 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:20:02 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:20:02 user nova-compute[73012]:     </rng>
Aug 14 12:20:02 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:20:02 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:20:02 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:20:02 user nova-compute[73012]:     </memballoon>
Aug 14 12:20:02 user nova-compute[73012]:   </devices>
Aug 14 12:20:02 user nova-compute[73012]: </domain>
Aug 14 12:20:02 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2032924741',display_name='tempest-AttachVolumeTestJSON-server-2032924741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2032924741',id=29,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI1LgcrTTw70xOoqnvcVDZtsOJhtmBHzQ19Oa/Uqxd3iuk4bkU5QYp2T1jIxwdRxvJI5QFQbqNJLL7XrstdskKAdhSkVcP7b1pJ7XBEdXgRVkMSdfZifb7EmSSsystmLA==',key_name='tempest-keypair-943368399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-7htr0z6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:20:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=56391331-dd5f-4641-8208-72ba5cd514a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG os_vif [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde12db03-27, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde12db03-27, col_values=(('external_ids', {'iface-id': 'de12db03-2755-471c-85d9-99fc6d4a0092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:4b:33', 'vm-uuid': '56391331-dd5f-4641-8208-72ba5cd514a4'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:02 user nova-compute[73012]: INFO os_vif [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27')
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No VIF found with MAC fa:16:3e:08:4b:33, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-da10ff7f-18d6-4387-a3a6-9cee1279f596 req-d437bc37-2389-4bda-800f-cd8968a0171e service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updated VIF entry in instance network info cache for port de12db03-2755-471c-85d9-99fc6d4a0092. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-da10ff7f-18d6-4387-a3a6-9cee1279f596 req-d437bc37-2389-4bda-800f-cd8968a0171e service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updating instance_info_cache with network_info: [{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:20:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-da10ff7f-18d6-4387-a3a6-9cee1279f596 req-d437bc37-2389-4bda-800f-cd8968a0171e service nova] Releasing lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:20:03 user nova-compute[73012]: WARNING nova.compute.manager [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state active and task_state rescuing.
Aug 14 12:20:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:20:03 user nova-compute[73012]: WARNING nova.compute.manager [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state active and task_state rescuing.
Aug 14 12:20:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:20:03 user nova-compute[73012]: WARNING nova.compute.manager [req-2d8d4eac-0463-41c1-850e-afe33b4cac0d req-5aadc36b-7c29-4717-81d6-0162f2a7075e service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state active and task_state rescuing.
Aug 14 12:20:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-23d6b743-9e6e-4c28-940a-c668f43999c0 req-209a91f2-155f-4823-b465-fe8f00c6cae0 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-23d6b743-9e6e-4c28-940a-c668f43999c0 req-209a91f2-155f-4823-b465-fe8f00c6cae0 service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-23d6b743-9e6e-4c28-940a-c668f43999c0 req-209a91f2-155f-4823-b465-fe8f00c6cae0 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-23d6b743-9e6e-4c28-940a-c668f43999c0 req-209a91f2-155f-4823-b465-fe8f00c6cae0 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-23d6b743-9e6e-4c28-940a-c668f43999c0 req-209a91f2-155f-4823-b465-fe8f00c6cae0 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:20:04 user nova-compute[73012]: WARNING nova.compute.manager [req-23d6b743-9e6e-4c28-940a-c668f43999c0 req-209a91f2-155f-4823-b465-fe8f00c6cae0 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state building and task_state spawning.
Aug 14 12:20:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for 73fcc85e-48fd-486b-bda8-61d834d8cb42 due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:20:05 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015605.5594838, 73fcc85e-48fd-486b-bda8-61d834d8cb42 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:20:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] VM Resumed (Lifecycle Event)
Aug 14 12:20:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c263a669-cd7c-4a56-8994-119aac477adc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:20:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:20:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:20:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 12:20:05 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015605.561401, 73fcc85e-48fd-486b-bda8-61d834d8cb42 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:20:05 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] VM Started (Lifecycle Event)
Aug 14 12:20:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:20:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015606.175526, 56391331-dd5f-4641-8208-72ba5cd514a4 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:20:06 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] VM Resumed (Lifecycle Event)
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:20:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance spawned successfully.
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:06 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015606.1756237, 56391331-dd5f-4641-8208-72ba5cd514a4 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:20:06 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] VM Started (Lifecycle Event)
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-37320559-eb94-40e7-8ede-980b4a832244 req-0ada25ea-2999-4373-85b3-4d1b539f60dd service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-37320559-eb94-40e7-8ede-980b4a832244 req-0ada25ea-2999-4373-85b3-4d1b539f60dd service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-37320559-eb94-40e7-8ede-980b4a832244 req-0ada25ea-2999-4373-85b3-4d1b539f60dd service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-37320559-eb94-40e7-8ede-980b4a832244 req-0ada25ea-2999-4373-85b3-4d1b539f60dd service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-37320559-eb94-40e7-8ede-980b4a832244 req-0ada25ea-2999-4373-85b3-4d1b539f60dd service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:20:06 user nova-compute[73012]: WARNING nova.compute.manager [req-37320559-eb94-40e7-8ede-980b4a832244 req-0ada25ea-2999-4373-85b3-4d1b539f60dd service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state rescued and task_state None.
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:20:06 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:20:06 user nova-compute[73012]: INFO nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:20:06 user nova-compute[73012]: INFO nova.compute.manager [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Took 7.09 seconds to build instance.
Aug 14 12:20:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-23444343-3a3d-49bc-bdb0-7be71b5b5f9f tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.179s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-d9729a40-63ad-46a0-bb05-36f4e05ca763 req-cddb02de-30cb-4ce8-b00b-9f3b2abaf661 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d9729a40-63ad-46a0-bb05-36f4e05ca763 req-cddb02de-30cb-4ce8-b00b-9f3b2abaf661 service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d9729a40-63ad-46a0-bb05-36f4e05ca763 req-cddb02de-30cb-4ce8-b00b-9f3b2abaf661 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d9729a40-63ad-46a0-bb05-36f4e05ca763 req-cddb02de-30cb-4ce8-b00b-9f3b2abaf661 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-d9729a40-63ad-46a0-bb05-36f4e05ca763 req-cddb02de-30cb-4ce8-b00b-9f3b2abaf661 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:20:06 user nova-compute[73012]: WARNING nova.compute.manager [req-d9729a40-63ad-46a0-bb05-36f4e05ca763 req-cddb02de-30cb-4ce8-b00b-9f3b2abaf661 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state active and task_state None.
Aug 14 12:20:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG nova.objects.instance [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:19 user nova-compute[73012]: INFO nova.compute.manager [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attaching volume 7bc0688a-193c-4368-8bd9-a727c604dc50 to /dev/vdb
Aug 14 12:20:19 user nova-compute[73012]: DEBUG os_brick.utils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1965fdcf-ca05-4d4d-9cc2-a7a8b5e47680]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1834cdcb-ce0a-48f6-975e-515d2590123f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[98793b04-983a-403e-a749-a6db063fc09f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e615cd08-6c36-4f0c-9c9a-e1f572ac0a51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:20:19 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:20:19 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d534c1fa-4390-452f-9e8a-499b56ac0246]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG os_brick.utils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:20:19 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updating existing volume attachment record: 3a9c5ed5-4d50-4714-9fc1-80b2e16b9064 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:20:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:20:31 user nova-compute[73012]: INFO nova.compute.claims [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Claim successful on node user
Aug 14 12:20:31 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:20:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:20:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:20:31 user nova-compute[73012]: INFO nova.virt.block_device [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Booting with volume 2283305a-807b-4e5e-afe8-8aa2346a3d61 at /dev/vda
Aug 14 12:20:31 user nova-compute[73012]: DEBUG nova.policy [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d6c467aee6140bda719332345af7ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5064d145e48eab20dc7ee82bdf779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG os_brick.utils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea8d253-21ee-4548-bc7f-223ac70b6b0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3264d0b8-d1bb-4b32-bc1d-2df6dc2eded4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e44927a-ff68-46f0-94fb-930a84732d40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0749aab7-8bb1-4c77-96ef-23f0ebb6beb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:20:31 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:20:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2de023-f133-4c91-af82-61e557697cff]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG os_brick.utils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:20:31 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating existing volume attachment record: f5473c62-d9ad-4b15-84f1-2bb7fd7dc8a8 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:20:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Successfully created port: de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:20:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Successfully updated port: de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:20:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:20:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquired lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:20:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:20:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-deda69f8-a56b-4172-bd81-050d86974f89 req-1c2ccf9d-21ac-4d54-a061-47813c48c4a5 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-changed-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-deda69f8-a56b-4172-bd81-050d86974f89 req-1c2ccf9d-21ac-4d54-a061-47813c48c4a5 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Refreshing instance network info cache due to event network-changed-de4870b2-3985-4363-bdc8-364805f9568a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:20:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-deda69f8-a56b-4172-bd81-050d86974f89 req-1c2ccf9d-21ac-4d54-a061-47813c48c4a5 service nova] Acquiring lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:20:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:20:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating instance_info_cache with network_info: [{"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:20:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Releasing lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:20:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Instance network_info: |[{"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:20:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-deda69f8-a56b-4172-bd81-050d86974f89 req-1c2ccf9d-21ac-4d54-a061-47813c48c4a5 service nova] Acquired lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:20:34 user nova-compute[73012]: DEBUG nova.network.neutron [req-deda69f8-a56b-4172-bd81-050d86974f89 req-1c2ccf9d-21ac-4d54-a061-47813c48c4a5 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Refreshing network info cache for port de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:20:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:20:34 user nova-compute[73012]: DEBUG nova.network.neutron [req-deda69f8-a56b-4172-bd81-050d86974f89 req-1c2ccf9d-21ac-4d54-a061-47813c48c4a5 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updated VIF entry in instance network info cache for port de4870b2-3985-4363-bdc8-364805f9568a. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:20:34 user nova-compute[73012]: DEBUG nova.network.neutron [req-deda69f8-a56b-4172-bd81-050d86974f89 req-1c2ccf9d-21ac-4d54-a061-47813c48c4a5 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating instance_info_cache with network_info: [{"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:20:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-deda69f8-a56b-4172-bd81-050d86974f89 req-1c2ccf9d-21ac-4d54-a061-47813c48c4a5 service nova] Releasing lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:20:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:20:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:20:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:37 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:20:37 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:20:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:20:38 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:20:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:20:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:20:38 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updating instance_info_cache with network_info: [{"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:20:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:20:43 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:20:43 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=25.289852142333984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 722de834-9535-4249-91b3-378e4b98f8e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 56391331-dd5f-4641-8208-72ba5cd514a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 53ee2aff-68a4-4015-82b3-30e842115c79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:20:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:20:44 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:20:44 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:20:44 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:20:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:20:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:20:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUxOTgvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:20:46 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:20:46 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:20:46 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8498d74b-b8ee-40ee-a0d3-3d81cb5c0e00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:20:46 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3297495-a09c-42b1-8ad8-27e2e3be68cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50] added
Aug 14 12:20:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5b45a-c929-4815-aedc-ac11bf948452]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35df033-4b5b-460c-a4c2-7ccc6a2692e8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUxOTgvX {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yUxOTgvX" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc8fa77-f9e3-4d75-ac55-2d70978b7923]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yUxOTgvX'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77868fd-5344-4b98-89f1-ff637fd725ed]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec701bb9-f1e5-4459-833c-09f989f70aa8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:46 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:46 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:46 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:46 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e4c04e-8e07-4bd2-81c3-6cb3294c5d67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50, portal: 172.16.0.220,3260]
Aug 14 12:20:46 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50, portal: 172.16.0.220,3260] successful.
Aug 14 12:20:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f012b85-cfdd-4afe-ac98-d73e9559ebb7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[132e2e08-ee57-48cd-a85f-9bcc4dcac1ec]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:47 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:47 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:47 user nova-compute[73012]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)
Aug 14 12:20:47 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:47 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:47 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:47 user nova-compute[73012]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)
Aug 14 12:20:47 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9f9398-c2c5-4d14-b3a7-4beba5350f55]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUxOTgvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:20:47 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Creating image(s)
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Ensure instance console log exists: /opt/stack/data/nova/instances/53ee2aff-68a4-4015-82b3-30e842115c79/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Start _get_guest_xml network_info=[{"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKYLRuEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53ee2aff-68a4-4015-82b3-30e842115c79', 'attached_at': '', 'detached_at': '', 'volume_id': '2283305a-807b-4e5e-afe8-8aa2346a3d61', 'serial': '2283305a-807b-4e5e-afe8-8aa2346a3d61'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'f5473c62-d9ad-4b15-84f1-2bb7fd7dc8a8', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:20:47 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:20:47 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKYLRuEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:20:47 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:20:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23138646639633634', 'path': '/dev/sde'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138646639633634', 'path': '/dev/sde'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.240s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:20:48 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:20:48 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG nova.objects.instance [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e5667d-ea1a-46c8-a5bc-5ae0db067a81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:20:48 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:20:48 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:20:48 user nova-compute[73012]:   <source dev="/dev/sde"/>
Aug 14 12:20:48 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:20:48 user nova-compute[73012]:   <serial>7bc0688a-193c-4368-8bd9-a727c604dc50</serial>
Aug 14 12:20:48 user nova-compute[73012]: </disk>
Aug 14 12:20:48 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2f7df2-138c-4de8-8be2-ef169537051a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61] added
Aug 14 12:20:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d593d19-7f36-4011-a02b-75204527cfdf]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c5ce75-8ef0-41d9-a26a-00b4484cbc37]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKYLRuEN {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKYLRuEN" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f62ecd-ca83-41f2-83c1-b91e086c053f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bKYLRuEN'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5099a614-bc20-40ac-a059-c806b131328f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d841aa-1e97-4916-97fb-695d9323620c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5daad8-4b1f-48d4-8c02-799ac7b6bf3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260]
Aug 14 12:20:48 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260] successful.
Aug 14 12:20:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[184456f1-35c8-4697-abd3-eb8ad4b702e5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee5aa0a-2486-4804-b5bd-0d9f7b798a4d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:20:48 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[05873503-8da0-480a-aa51-7e1a05e53e8f]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKYLRuEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No VIF found with MAC fa:16:3e:2d:27:fb, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:20:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-19b54312-7e94-4a5c-a165-b62b6d02e651 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.898s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== connect_volume: return (1592ms) {'type': 'block', 'scsi_wwn': '26231333638306439', 'path': '/dev/sdf'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231333638306439', 'path': '/dev/sdf'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269061199',display_name='tempest-ServerActionsTestOtherA-server-1269061199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269061199',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFloYN1ReWoKPyBlc0SLCyu4ynKhd4hHFwk9GiyUMnITdI9Vxx2/nsK5EMWhGjgXLC4h+Dyjic41yKG1TsZ9FF3dSkrQKzlOkDc47k70qj4dK+sgWipPTYpvmqVW5R9Xg==',key_name='tempest-keypair-1585640726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-2r7zlbth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=53ee2aff-68a4-4015-82b3-30e842115c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.objects.instance [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'pci_devices' on Instance uuid 53ee2aff-68a4-4015-82b3-30e842115c79 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:20:49 user nova-compute[73012]:   <uuid>53ee2aff-68a4-4015-82b3-30e842115c79</uuid>
Aug 14 12:20:49 user nova-compute[73012]:   <name>instance-0000001e</name>
Aug 14 12:20:49 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:20:49 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:20:49 user nova-compute[73012]:   <metadata>
Aug 14 12:20:49 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:20:49 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:20:49 user nova-compute[73012]:       <nova:name>tempest-ServerActionsTestOtherA-server-1269061199</nova:name>
Aug 14 12:20:49 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:20:47</nova:creationTime>
Aug 14 12:20:49 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:20:49 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:20:49 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:20:49 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:20:49 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:20:49 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:20:49 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:20:49 user nova-compute[73012]:       <nova:owner>
Aug 14 12:20:49 user nova-compute[73012]:         <nova:user uuid="7d6c467aee6140bda719332345af7ec0">tempest-ServerActionsTestOtherA-975401032-project-member</nova:user>
Aug 14 12:20:49 user nova-compute[73012]:         <nova:project uuid="33d5064d145e48eab20dc7ee82bdf779">tempest-ServerActionsTestOtherA-975401032</nova:project>
Aug 14 12:20:49 user nova-compute[73012]:       </nova:owner>
Aug 14 12:20:49 user nova-compute[73012]:       <nova:ports>
Aug 14 12:20:49 user nova-compute[73012]:         <nova:port uuid="de4870b2-3985-4363-bdc8-364805f9568a">
Aug 14 12:20:49 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:20:49 user nova-compute[73012]:         </nova:port>
Aug 14 12:20:49 user nova-compute[73012]:       </nova:ports>
Aug 14 12:20:49 user nova-compute[73012]:     </nova:instance>
Aug 14 12:20:49 user nova-compute[73012]:   </metadata>
Aug 14 12:20:49 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:20:49 user nova-compute[73012]:     <system>
Aug 14 12:20:49 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:20:49 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:20:49 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:20:49 user nova-compute[73012]:       <entry name="serial">53ee2aff-68a4-4015-82b3-30e842115c79</entry>
Aug 14 12:20:49 user nova-compute[73012]:       <entry name="uuid">53ee2aff-68a4-4015-82b3-30e842115c79</entry>
Aug 14 12:20:49 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:20:49 user nova-compute[73012]:     </system>
Aug 14 12:20:49 user nova-compute[73012]:   </sysinfo>
Aug 14 12:20:49 user nova-compute[73012]:   <os>
Aug 14 12:20:49 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:20:49 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:20:49 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:20:49 user nova-compute[73012]:   </os>
Aug 14 12:20:49 user nova-compute[73012]:   <features>
Aug 14 12:20:49 user nova-compute[73012]:     <acpi/>
Aug 14 12:20:49 user nova-compute[73012]:     <apic/>
Aug 14 12:20:49 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:20:49 user nova-compute[73012]:   </features>
Aug 14 12:20:49 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:20:49 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:20:49 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:20:49 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:20:49 user nova-compute[73012]:   </clock>
Aug 14 12:20:49 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:20:49 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:20:49 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:20:49 user nova-compute[73012]:   </cpu>
Aug 14 12:20:49 user nova-compute[73012]:   <devices>
Aug 14 12:20:49 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:20:49 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:20:49 user nova-compute[73012]:       <source dev="/dev/sdf"/>
Aug 14 12:20:49 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:20:49 user nova-compute[73012]:       <serial>2283305a-807b-4e5e-afe8-8aa2346a3d61</serial>
Aug 14 12:20:49 user nova-compute[73012]:     </disk>
Aug 14 12:20:49 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:20:49 user nova-compute[73012]:       <mac address="fa:16:3e:0f:c2:c2"/>
Aug 14 12:20:49 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:20:49 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:20:49 user nova-compute[73012]:       <target dev="tapde4870b2-39"/>
Aug 14 12:20:49 user nova-compute[73012]:     </interface>
Aug 14 12:20:49 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:20:49 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/53ee2aff-68a4-4015-82b3-30e842115c79/console.log" append="off"/>
Aug 14 12:20:49 user nova-compute[73012]:     </serial>
Aug 14 12:20:49 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:20:49 user nova-compute[73012]:     <video>
Aug 14 12:20:49 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:20:49 user nova-compute[73012]:     </video>
Aug 14 12:20:49 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:20:49 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:20:49 user nova-compute[73012]:     </rng>
Aug 14 12:20:49 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:20:49 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:20:49 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:20:49 user nova-compute[73012]:     </memballoon>
Aug 14 12:20:49 user nova-compute[73012]:   </devices>
Aug 14 12:20:49 user nova-compute[73012]: </domain>
Aug 14 12:20:49 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269061199',display_name='tempest-ServerActionsTestOtherA-server-1269061199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269061199',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFloYN1ReWoKPyBlc0SLCyu4ynKhd4hHFwk9GiyUMnITdI9Vxx2/nsK5EMWhGjgXLC4h+Dyjic41yKG1TsZ9FF3dSkrQKzlOkDc47k70qj4dK+sgWipPTYpvmqVW5R9Xg==',key_name='tempest-keypair-1585640726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-2r7zlbth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:20:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=53ee2aff-68a4-4015-82b3-30e842115c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG os_vif [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde4870b2-39, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde4870b2-39, col_values=(('external_ids', {'iface-id': 'de4870b2-3985-4363-bdc8-364805f9568a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:c2:c2', 'vm-uuid': '53ee2aff-68a4-4015-82b3-30e842115c79'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:49 user nova-compute[73012]: INFO os_vif [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39')
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:20:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No VIF found with MAC fa:16:3e:0f:c2:c2, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:20:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:50 user nova-compute[73012]: INFO nova.compute.manager [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Detaching volume 7bc0688a-193c-4368-8bd9-a727c604dc50
Aug 14 12:20:50 user nova-compute[73012]: INFO nova.virt.block_device [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attempting to driver detach volume 7bc0688a-193c-4368-8bd9-a727c604dc50 from mountpoint /dev/vdb
Aug 14 12:20:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Attempting to detach device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:20:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:20:50 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:20:50 user nova-compute[73012]:   <source dev="/dev/sde"/>
Aug 14 12:20:50 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:20:50 user nova-compute[73012]:   <serial>7bc0688a-193c-4368-8bd9-a727c604dc50</serial>
Aug 14 12:20:50 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:20:50 user nova-compute[73012]: </disk>
Aug 14 12:20:50 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:20:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully detached device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the persistent domain config.
Aug 14 12:20:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:20:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:20:50 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:20:50 user nova-compute[73012]:   <source dev="/dev/sde"/>
Aug 14 12:20:50 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:20:50 user nova-compute[73012]:   <serial>7bc0688a-193c-4368-8bd9-a727c604dc50</serial>
Aug 14 12:20:50 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:20:50 user nova-compute[73012]: </disk>
Aug 14 12:20:50 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:20:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-004826b0-18d6-47db-9e68-a0c6411b8a15 req-5e6adff4-77d5-4e4f-b3e2-e6e7f2cc59b6 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-004826b0-18d6-47db-9e68-a0c6411b8a15 req-5e6adff4-77d5-4e4f-b3e2-e6e7f2cc59b6 service nova] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-004826b0-18d6-47db-9e68-a0c6411b8a15 req-5e6adff4-77d5-4e4f-b3e2-e6e7f2cc59b6 service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-004826b0-18d6-47db-9e68-a0c6411b8a15 req-5e6adff4-77d5-4e4f-b3e2-e6e7f2cc59b6 service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-004826b0-18d6-47db-9e68-a0c6411b8a15 req-5e6adff4-77d5-4e4f-b3e2-e6e7f2cc59b6 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] No waiting events found dispatching network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:20:51 user nova-compute[73012]: WARNING nova.compute.manager [req-004826b0-18d6-47db-9e68-a0c6411b8a15 req-5e6adff4-77d5-4e4f-b3e2-e6e7f2cc59b6 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received unexpected event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a for instance with vm_state building and task_state spawning.
Aug 14 12:20:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015651.2395444, 8e51a9ce-cd61-4c43-a297-7f313bf2a07c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:20:51 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully detached device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the live domain config.
Aug 14 12:20:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yUxOTgvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:20:51 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf2471c-90f4-4fdc-874a-bdb783c82aa6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a117e34-d1be-4e3a-866c-4d638837c50a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:20:51 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aace94280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50'): ({'sde'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Removing single pathed devices sde {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8101011-36dc-4cef-9d63-6d9b2aef588b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f530fd-903a-41fd-9c9e-a132ce8c297a]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Flushing IO for device /dev/sde {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f883e-3e8e-42c4-90be-83c667dac260]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa1395f-3d9c-4f70-aec0-e5c338cbed82]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6291d8-00cb-447d-90dd-d83e2536a3f3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[97efa963-4e60-4e00-8104-edc414e5c20d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50, portal: 172.16.0.220,3260]
Aug 14 12:20:51 user nova-compute[73012]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50, portal: 172.16.0.220,3260] successful.
Aug 14 12:20:51 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc0688a-193c-4368-8bd9-a727c604dc50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c242de-b8f1-4afc-8595-05a7791ee0e5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== disconnect_volume: return (279ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:20:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:20:52 user nova-compute[73012]: DEBUG nova.objects.instance [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:20:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5b6672ab-eb72-45b7-abc5-fdb9954c636a tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-bcfc7c4d-d290-4e14-97b5-a34eb6fb4071 req-4d0d1287-cf79-4557-89c8-df90ca6699d5 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bcfc7c4d-d290-4e14-97b5-a34eb6fb4071 req-4d0d1287-cf79-4557-89c8-df90ca6699d5 service nova] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bcfc7c4d-d290-4e14-97b5-a34eb6fb4071 req-4d0d1287-cf79-4557-89c8-df90ca6699d5 service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bcfc7c4d-d290-4e14-97b5-a34eb6fb4071 req-4d0d1287-cf79-4557-89c8-df90ca6699d5 service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-bcfc7c4d-d290-4e14-97b5-a34eb6fb4071 req-4d0d1287-cf79-4557-89c8-df90ca6699d5 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] No waiting events found dispatching network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:20:53 user nova-compute[73012]: WARNING nova.compute.manager [req-bcfc7c4d-d290-4e14-97b5-a34eb6fb4071 req-4d0d1287-cf79-4557-89c8-df90ca6699d5 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received unexpected event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a for instance with vm_state building and task_state spawning.
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015653.388337, 53ee2aff-68a4-4015-82b3-30e842115c79 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:20:53 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] VM Resumed (Lifecycle Event)
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:20:53 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Instance spawned successfully.
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:20:53 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015653.3897774, 53ee2aff-68a4-4015-82b3-30e842115c79 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:20:53 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] VM Started (Lifecycle Event)
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:20:53 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:20:53 user nova-compute[73012]: INFO nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 14 12:20:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:20:53 user nova-compute[73012]: INFO nova.compute.manager [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Took 22.55 seconds to build instance.
Aug 14 12:20:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bb5625b2-2fd9-4bcd-b69e-766fc2e21f0e tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.689s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:20:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:20:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:21:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:21:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:21:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:21:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:21:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:21:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:21:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:21:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c1d7499-29e6-4239-887c-167a8a74c729 req-2d7afe34-9b26-43d5-90eb-23a6e0bae8f4 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c1d7499-29e6-4239-887c-167a8a74c729 req-2d7afe34-9b26-43d5-90eb-23a6e0bae8f4 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing instance network info cache due to event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:21:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c1d7499-29e6-4239-887c-167a8a74c729 req-2d7afe34-9b26-43d5-90eb-23a6e0bae8f4 service nova] Acquiring lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:21:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c1d7499-29e6-4239-887c-167a8a74c729 req-2d7afe34-9b26-43d5-90eb-23a6e0bae8f4 service nova] Acquired lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:21:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-7c1d7499-29e6-4239-887c-167a8a74c729 req-2d7afe34-9b26-43d5-90eb-23a6e0bae8f4 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:21:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-7c1d7499-29e6-4239-887c-167a8a74c729 req-2d7afe34-9b26-43d5-90eb-23a6e0bae8f4 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updated VIF entry in instance network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-7c1d7499-29e6-4239-887c-167a8a74c729 req-2d7afe34-9b26-43d5-90eb-23a6e0bae8f4 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updating instance_info_cache with network_info: [{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c1d7499-29e6-4239-887c-167a8a74c729 req-2d7afe34-9b26-43d5-90eb-23a6e0bae8f4 service nova] Releasing lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-c1329d2a-9485-4cb2-b99e-f232d590764c req-e604ed29-84bf-4e7f-8b8b-36156c1957c5 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-c1329d2a-9485-4cb2-b99e-f232d590764c req-e604ed29-84bf-4e7f-8b8b-36156c1957c5 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing instance network info cache due to event network-changed-e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1329d2a-9485-4cb2-b99e-f232d590764c req-e604ed29-84bf-4e7f-8b8b-36156c1957c5 service nova] Acquiring lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1329d2a-9485-4cb2-b99e-f232d590764c req-e604ed29-84bf-4e7f-8b8b-36156c1957c5 service nova] Acquired lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-c1329d2a-9485-4cb2-b99e-f232d590764c req-e604ed29-84bf-4e7f-8b8b-36156c1957c5 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Refreshing network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:26 user nova-compute[73012]: INFO nova.compute.manager [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Detaching volume 1a4b7337-0a97-4f71-9ffd-e6efbc42bb64
Aug 14 12:21:26 user nova-compute[73012]: INFO nova.virt.block_device [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Attempting to driver detach volume 1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 from mountpoint /dev/vdb
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Attempting to detach device vdb from instance 722de834-9535-4249-91b3-378e4b98f8e0 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:21:26 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:21:26 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:21:26 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:21:26 user nova-compute[73012]:   <serial>1a4b7337-0a97-4f71-9ffd-e6efbc42bb64</serial>
Aug 14 12:21:26 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 12:21:26 user nova-compute[73012]: </disk>
Aug 14 12:21:26 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:21:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully detached device vdb from instance 722de834-9535-4249-91b3-378e4b98f8e0 from the persistent domain config.
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 722de834-9535-4249-91b3-378e4b98f8e0 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:21:26 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:21:26 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:21:26 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:21:26 user nova-compute[73012]:   <serial>1a4b7337-0a97-4f71-9ffd-e6efbc42bb64</serial>
Aug 14 12:21:26 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 12:21:26 user nova-compute[73012]: </disk>
Aug 14 12:21:26 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-c1329d2a-9485-4cb2-b99e-f232d590764c req-e604ed29-84bf-4e7f-8b8b-36156c1957c5 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updated VIF entry in instance network info cache for port e0ba563f-c8ca-48c4-8954-be7f64edde26. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG nova.network.neutron [req-c1329d2a-9485-4cb2-b99e-f232d590764c req-e604ed29-84bf-4e7f-8b8b-36156c1957c5 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updating instance_info_cache with network_info: [{"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:21:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1329d2a-9485-4cb2-b99e-f232d590764c req-e604ed29-84bf-4e7f-8b8b-36156c1957c5 service nova] Releasing lock "refresh_cache-722de834-9535-4249-91b3-378e4b98f8e0" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015687.003802, 722de834-9535-4249-91b3-378e4b98f8e0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:21:27 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully detached device vdb from instance 722de834-9535-4249-91b3-378e4b98f8e0 from the live domain config.
Aug 14 12:21:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oebJwjXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:21:27 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a25d6d-725f-489f-bfc2-30173b50bd77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[75af1c1e-ab8b-4124-b10e-2492be76b2e0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:21:27 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:21:27 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:21:27 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:21:27 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:21:27 user nova-compute[73012]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 (non-flash)
Aug 14 12:21:27 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:21:27 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:21:27 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0149510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad9d603-d522-4c36-bc6f-4a5f5709b3f2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f0cd3d-fa89-4cba-a19b-5c4baa4a77e1]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c28fcaa-3700-4870-b0f8-1212342152c7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f668519c-ae47-41c9-9953-1137cf5720e6]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a918629-b79c-4ac1-a764-1bc61c66043f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2234af50-0344-4fbf-abc0-f90a8225bd1a]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260]
Aug 14 12:21:27 user nova-compute[73012]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64, portal: 172.16.0.220,3260] successful.
Aug 14 12:21:27 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a4b7337-0a97-4f71-9ffd-e6efbc42bb64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9350b808-e10b-4cd9-8821-e77e85b7cb43]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] <== disconnect_volume: return (269ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:21:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:28 user nova-compute[73012]: DEBUG nova.objects.instance [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'flavor' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:21:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-92ded45d-4228-4891-aef9-c2f94f6b104b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.685s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:21:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:21:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:21:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:21:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:35 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:37 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:37 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:37 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:21:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:39 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:21:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:21:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:21:39 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updating instance_info_cache with network_info: [{"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-8e51a9ce-cd61-4c43-a297-7f313bf2a07c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:21:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:21:44 user nova-compute[73012]: INFO nova.compute.claims [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Claim successful on node user
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:44 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:21:44 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:21:44 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7610MB free_disk=25.27896499633789GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:45 user nova-compute[73012]: INFO nova.compute.manager [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attaching volume 5f3545eb-d94c-4efe-9297-395a2283cf8b to /dev/vdb
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG os_brick.utils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.059s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.330s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91f0603-d9a7-451f-93b5-85733a0682b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[83035955-f190-43a9-a92e-4e3d424549df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52db99b-cf20-4a31-9791-9cbc6c6773de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[56702af6-5358-4f18-b00c-3517adf85809]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:21:45 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61da79a-b1df-43b7-aa9e-218395f4786d]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.network.neutron [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG os_brick.utils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updating existing volume attachment record: f5442665-18db-4580-8162-8c80db6c60d4 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:21:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 722de834-9535-4249-91b3-378e4b98f8e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 56391331-dd5f-4641-8208-72ba5cd514a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 53ee2aff-68a4-4015-82b3-30e842115c79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.policy [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae1ce3345617447486642ebe88c1621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1960abc96445f483386773f67d83e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:21:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Creating image(s)
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "/opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "/opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.196s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk 1073741824" returned: 0 in 0.049s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG nova.network.neutron [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Successfully created port: eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Cannot resize image /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG nova.objects.instance [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'migration_context' on Instance uuid bf1c2e78-360e-43fe-96f9-46e9d3c030fc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Ensure instance console log exists: /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Successfully updated port: eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "refresh_cache-bf1c2e78-360e-43fe-96f9-46e9d3c030fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquired lock "refresh_cache-bf1c2e78-360e-43fe-96f9-46e9d3c030fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-1d892619-93ad-4112-b736-af5fe61ca5c2 req-5cb87ff8-7079-424e-9452-b60fe5bf2aaa service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received event network-changed-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-1d892619-93ad-4112-b736-af5fe61ca5c2 req-5cb87ff8-7079-424e-9452-b60fe5bf2aaa service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Refreshing instance network info cache due to event network-changed-eb488e19-4d9e-4538-976a-6e578c0edac4. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1d892619-93ad-4112-b736-af5fe61ca5c2 req-5cb87ff8-7079-424e-9452-b60fe5bf2aaa service nova] Acquiring lock "refresh_cache-bf1c2e78-360e-43fe-96f9-46e9d3c030fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Updating instance_info_cache with network_info: [{"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Releasing lock "refresh_cache-bf1c2e78-360e-43fe-96f9-46e9d3c030fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Instance network_info: |[{"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1d892619-93ad-4112-b736-af5fe61ca5c2 req-5cb87ff8-7079-424e-9452-b60fe5bf2aaa service nova] Acquired lock "refresh_cache-bf1c2e78-360e-43fe-96f9-46e9d3c030fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.network.neutron [req-1d892619-93ad-4112-b736-af5fe61ca5c2 req-5cb87ff8-7079-424e-9452-b60fe5bf2aaa service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Refreshing network info cache for port eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Start _get_guest_xml network_info=[{"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:21:47 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:21:47 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1524203305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1524203305',id=31,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-t229mka4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:21:46Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=bf1c2e78-360e-43fe-96f9-46e9d3c030fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:ad:b3,bridge_name='br-int',has_traffic_filtering=True,id=eb488e19-4d9e-4538-976a-6e578c0edac4,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb488e19-4d') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.objects.instance [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'pci_devices' on Instance uuid bf1c2e78-360e-43fe-96f9-46e9d3c030fc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:21:47 user nova-compute[73012]:   <uuid>bf1c2e78-360e-43fe-96f9-46e9d3c030fc</uuid>
Aug 14 12:21:47 user nova-compute[73012]:   <name>instance-0000001f</name>
Aug 14 12:21:47 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:21:47 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:21:47 user nova-compute[73012]:   <metadata>
Aug 14 12:21:47 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:21:47 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:21:47 user nova-compute[73012]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1524203305</nova:name>
Aug 14 12:21:47 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:21:47</nova:creationTime>
Aug 14 12:21:47 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:21:47 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:21:47 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:21:47 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:21:47 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:21:47 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:21:47 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:21:47 user nova-compute[73012]:       <nova:owner>
Aug 14 12:21:47 user nova-compute[73012]:         <nova:user uuid="ae1ce3345617447486642ebe88c1621c">tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member</nova:user>
Aug 14 12:21:47 user nova-compute[73012]:         <nova:project uuid="6b1960abc96445f483386773f67d83e3">tempest-ServerBootFromVolumeStableRescueTest-1756944789</nova:project>
Aug 14 12:21:47 user nova-compute[73012]:       </nova:owner>
Aug 14 12:21:47 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:21:47 user nova-compute[73012]:       <nova:ports>
Aug 14 12:21:47 user nova-compute[73012]:         <nova:port uuid="eb488e19-4d9e-4538-976a-6e578c0edac4">
Aug 14 12:21:47 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 12:21:47 user nova-compute[73012]:         </nova:port>
Aug 14 12:21:47 user nova-compute[73012]:       </nova:ports>
Aug 14 12:21:47 user nova-compute[73012]:     </nova:instance>
Aug 14 12:21:47 user nova-compute[73012]:   </metadata>
Aug 14 12:21:47 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:21:47 user nova-compute[73012]:     <system>
Aug 14 12:21:47 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:21:47 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:21:47 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:21:47 user nova-compute[73012]:       <entry name="serial">bf1c2e78-360e-43fe-96f9-46e9d3c030fc</entry>
Aug 14 12:21:47 user nova-compute[73012]:       <entry name="uuid">bf1c2e78-360e-43fe-96f9-46e9d3c030fc</entry>
Aug 14 12:21:47 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:21:47 user nova-compute[73012]:     </system>
Aug 14 12:21:47 user nova-compute[73012]:   </sysinfo>
Aug 14 12:21:47 user nova-compute[73012]:   <os>
Aug 14 12:21:47 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:21:47 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:21:47 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:21:47 user nova-compute[73012]:   </os>
Aug 14 12:21:47 user nova-compute[73012]:   <features>
Aug 14 12:21:47 user nova-compute[73012]:     <acpi/>
Aug 14 12:21:47 user nova-compute[73012]:     <apic/>
Aug 14 12:21:47 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:21:47 user nova-compute[73012]:   </features>
Aug 14 12:21:47 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:21:47 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:21:47 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:21:47 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:21:47 user nova-compute[73012]:   </clock>
Aug 14 12:21:47 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:21:47 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:21:47 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:21:47 user nova-compute[73012]:   </cpu>
Aug 14 12:21:47 user nova-compute[73012]:   <devices>
Aug 14 12:21:47 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:21:47 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:21:47 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk"/>
Aug 14 12:21:47 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:21:47 user nova-compute[73012]:     </disk>
Aug 14 12:21:47 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:21:47 user nova-compute[73012]:       <mac address="fa:16:3e:63:ad:b3"/>
Aug 14 12:21:47 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:21:47 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:21:47 user nova-compute[73012]:       <target dev="tapeb488e19-4d"/>
Aug 14 12:21:47 user nova-compute[73012]:     </interface>
Aug 14 12:21:47 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:21:47 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/console.log" append="off"/>
Aug 14 12:21:47 user nova-compute[73012]:     </serial>
Aug 14 12:21:47 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:21:47 user nova-compute[73012]:     <video>
Aug 14 12:21:47 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:21:47 user nova-compute[73012]:     </video>
Aug 14 12:21:47 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:21:47 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:21:47 user nova-compute[73012]:     </rng>
Aug 14 12:21:47 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:21:47 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:21:47 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:21:47 user nova-compute[73012]:     </memballoon>
Aug 14 12:21:47 user nova-compute[73012]:   </devices>
Aug 14 12:21:47 user nova-compute[73012]: </domain>
Aug 14 12:21:47 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1524203305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1524203305',id=31,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-t229mka4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:21:46Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=bf1c2e78-360e-43fe-96f9-46e9d3c030fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:ad:b3,bridge_name='br-int',has_traffic_filtering=True,id=eb488e19-4d9e-4538-976a-6e578c0edac4,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb488e19-4d') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG os_vif [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:ad:b3,bridge_name='br-int',has_traffic_filtering=True,id=eb488e19-4d9e-4538-976a-6e578c0edac4,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb488e19-4d') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb488e19-4d, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb488e19-4d, col_values=(('external_ids', {'iface-id': 'eb488e19-4d9e-4538-976a-6e578c0edac4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:ad:b3', 'vm-uuid': 'bf1c2e78-360e-43fe-96f9-46e9d3c030fc'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:47 user nova-compute[73012]: INFO os_vif [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:ad:b3,bridge_name='br-int',has_traffic_filtering=True,id=eb488e19-4d9e-4538-976a-6e578c0edac4,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb488e19-4d')
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:21:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No VIF found with MAC fa:16:3e:63:ad:b3, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:21:48 user nova-compute[73012]: DEBUG nova.network.neutron [req-1d892619-93ad-4112-b736-af5fe61ca5c2 req-5cb87ff8-7079-424e-9452-b60fe5bf2aaa service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Updated VIF entry in instance network info cache for port eb488e19-4d9e-4538-976a-6e578c0edac4. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:21:48 user nova-compute[73012]: DEBUG nova.network.neutron [req-1d892619-93ad-4112-b736-af5fe61ca5c2 req-5cb87ff8-7079-424e-9452-b60fe5bf2aaa service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Updating instance_info_cache with network_info: [{"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:21:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1d892619-93ad-4112-b736-af5fe61ca5c2 req-5cb87ff8-7079-424e-9452-b60fe5bf2aaa service nova] Releasing lock "refresh_cache-bf1c2e78-360e-43fe-96f9-46e9d3c030fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:21:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:21:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:21:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-66cb011f-2734-4aa1-b941-4a966fb2d2ab req-24caaaea-e33f-4345-85b5-57909766c3b2 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received event network-vif-plugged-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-66cb011f-2734-4aa1-b941-4a966fb2d2ab req-24caaaea-e33f-4345-85b5-57909766c3b2 service nova] Acquiring lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-66cb011f-2734-4aa1-b941-4a966fb2d2ab req-24caaaea-e33f-4345-85b5-57909766c3b2 service nova] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-66cb011f-2734-4aa1-b941-4a966fb2d2ab req-24caaaea-e33f-4345-85b5-57909766c3b2 service nova] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-66cb011f-2734-4aa1-b941-4a966fb2d2ab req-24caaaea-e33f-4345-85b5-57909766c3b2 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] No waiting events found dispatching network-vif-plugged-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:49 user nova-compute[73012]: WARNING nova.compute.manager [req-66cb011f-2734-4aa1-b941-4a966fb2d2ab req-24caaaea-e33f-4345-85b5-57909766c3b2 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received unexpected event network-vif-plugged-eb488e19-4d9e-4538-976a-6e578c0edac4 for instance with vm_state building and task_state spawning.
Aug 14 12:21:49 user nova-compute[73012]: INFO nova.compute.manager [None req-ae32b798-ad75-49ef-8b2f-f851711afafc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Unrescuing
Aug 14 12:21:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ae32b798-ad75-49ef-8b2f-f851711afafc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ae32b798-ad75-49ef-8b2f-f851711afafc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquired lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:21:49 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ae32b798-ad75-49ef-8b2f-f851711afafc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:21:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ae32b798-ad75-49ef-8b2f-f851711afafc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updating instance_info_cache with network_info: [{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:21:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ae32b798-ad75-49ef-8b2f-f851711afafc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Releasing lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:21:50 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ae32b798-ad75-49ef-8b2f-f851711afafc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'flavor' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-18315be3-6fe2-4a90-aaa6-c11f1fd0ab9b req-7bfbb2b0-f9cb-4ff6-ac66-00ead5d1ce7a service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-changed-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-18315be3-6fe2-4a90-aaa6-c11f1fd0ab9b req-7bfbb2b0-f9cb-4ff6-ac66-00ead5d1ce7a service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Refreshing instance network info cache due to event network-changed-de12db03-2755-471c-85d9-99fc6d4a0092. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-18315be3-6fe2-4a90-aaa6-c11f1fd0ab9b req-7bfbb2b0-f9cb-4ff6-ac66-00ead5d1ce7a service nova] Acquiring lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-18315be3-6fe2-4a90-aaa6-c11f1fd0ab9b req-7bfbb2b0-f9cb-4ff6-ac66-00ead5d1ce7a service nova] Acquired lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.network.neutron [req-18315be3-6fe2-4a90-aaa6-c11f1fd0ab9b req-7bfbb2b0-f9cb-4ff6-ac66-00ead5d1ce7a service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Refreshing network info cache for port de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015711.6291916, bf1c2e78-360e-43fe-96f9-46e9d3c030fc => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:21:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] VM Resumed (Lifecycle Event)
Aug 14 12:21:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-77bbdfd0-aee8-459c-9887-bd9613d2a6c7 req-6c22a320-bb93-4b13-8596-e45a870ff0ce service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received event network-vif-plugged-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-77bbdfd0-aee8-459c-9887-bd9613d2a6c7 req-6c22a320-bb93-4b13-8596-e45a870ff0ce service nova] Acquiring lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-77bbdfd0-aee8-459c-9887-bd9613d2a6c7 req-6c22a320-bb93-4b13-8596-e45a870ff0ce service nova] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-77bbdfd0-aee8-459c-9887-bd9613d2a6c7 req-6c22a320-bb93-4b13-8596-e45a870ff0ce service nova] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-77bbdfd0-aee8-459c-9887-bd9613d2a6c7 req-6c22a320-bb93-4b13-8596-e45a870ff0ce service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] No waiting events found dispatching network-vif-plugged-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:51 user nova-compute[73012]: WARNING nova.compute.manager [req-77bbdfd0-aee8-459c-9887-bd9613d2a6c7 req-6c22a320-bb93-4b13-8596-e45a870ff0ce service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received unexpected event network-vif-plugged-eb488e19-4d9e-4538-976a-6e578c0edac4 for instance with vm_state building and task_state spawning.
Aug 14 12:21:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:51 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Instance spawned successfully.
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:21:51 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Instance destroyed successfully.
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:21:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015711.639119, bf1c2e78-360e-43fe-96f9-46e9d3c030fc => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:21:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] VM Started (Lifecycle Event)
Aug 14 12:21:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:21:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:21:51 user nova-compute[73012]: INFO nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 14 12:21:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:21:52 user nova-compute[73012]: INFO nova.compute.manager [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Took 7.87 seconds to build instance.
Aug 14 12:21:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a3d0aab-52f0-4daf-9e39-d752e7a42867 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.021s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:53 user nova-compute[73012]: WARNING nova.compute.manager [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:21:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:53 user nova-compute[73012]: WARNING nova.compute.manager [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:21:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:53 user nova-compute[73012]: WARNING nova.compute.manager [req-e279b386-2b0b-4773-b948-bb8671715fa5 req-f1fdbe23-1735-464d-931e-e63a8aff9682 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:21:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG nova.network.neutron [req-18315be3-6fe2-4a90-aaa6-c11f1fd0ab9b req-7bfbb2b0-f9cb-4ff6-ac66-00ead5d1ce7a service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updated VIF entry in instance network info cache for port de12db03-2755-471c-85d9-99fc6d4a0092. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG nova.network.neutron [req-18315be3-6fe2-4a90-aaa6-c11f1fd0ab9b req-7bfbb2b0-f9cb-4ff6-ac66-00ead5d1ce7a service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updating instance_info_cache with network_info: [{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-18315be3-6fe2-4a90-aaa6-c11f1fd0ab9b req-7bfbb2b0-f9cb-4ff6-ac66-00ead5d1ce7a service nova] Releasing lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtocHBan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:21:55 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:21:55 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:21:55 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebd9ff1-7a8f-45a7-921b-21436a8797c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:21:55 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd68291-eeb7-48ad-aadf-6063847a33f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b] added
Aug 14 12:21:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:55 user nova-compute[73012]: WARNING nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:55 user nova-compute[73012]: WARNING nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:55 user nova-compute[73012]: WARNING nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:55 user nova-compute[73012]: WARNING nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:21:55 user nova-compute[73012]: WARNING nova.compute.manager [req-b007fc3c-7080-4a60-b3d2-dae553714271 req-b4917123-397e-47af-ab08-135f8020a6b9 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9128e563-496a-4cf3-bd2f-a3a29d5557c7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[993cd108-b92b-4820-8327-97a77ae44863]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtocHBan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtocHBan" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c10f631-93db-4052-918b-691f2a925b8d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UtocHBan'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[961409dd-d839-4ee2-82a4-0f353e0cd25c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82b28ce-b1ab-46b8-8007-bf6cff18fcd9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6704c20-4acb-4c3b-920f-f0ce31b02a12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b, portal: 172.16.0.220,3260]
Aug 14 12:21:55 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b, portal: 172.16.0.220,3260] successful.
Aug 14 12:21:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f843f2-6b67-4aac-95fb-8b56f00a4374]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b030c3d1-a62c-41c2-83ab-78b39513c96b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b (non-flash)
Aug 14 12:21:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:21:55 user nova-compute[73012]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b (non-flash)
Aug 14 12:21:55 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb7188e-a866-42d3-a5c2-25c2546bedef]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtocHBan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:55 user nova-compute[73012]: INFO nova.compute.manager [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Attaching volume 1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a to /dev/vdb
Aug 14 12:21:55 user nova-compute[73012]: DEBUG os_brick.utils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a0543-0e79-44bd-857c-ac1a7b8566f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5666d56-8871-46f0-aebe-c6a4c749d300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce21a31-164e-4f62-954c-4cba09a3fd18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6580fe9-810a-4114-8c9a-aa93dab1c546]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:21:56 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:21:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b38becd-b0ef-4e56-b22d-ac48b18adfc4]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG os_brick.utils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updating existing volume attachment record: 4b0aa558-aacc-4403-a182-ceee3d548222 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for 73fcc85e-48fd-486b-bda8-61d834d8cb42 due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015716.2566395, 73fcc85e-48fd-486b-bda8-61d834d8cb42 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:21:56 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] VM Resumed (Lifecycle Event)
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ae32b798-ad75-49ef-8b2f-f851711afafc tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:21:56 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015716.257298, 73fcc85e-48fd-486b-bda8-61d834d8cb42 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:21:56 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] VM Started (Lifecycle Event)
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23765623466343238', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765623466343238', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:21:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:21:56 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:21:56 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:21:56 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:21:56 user nova-compute[73012]:   <serial>5f3545eb-d94c-4efe-9297-395a2283cf8b</serial>
Aug 14 12:21:56 user nova-compute[73012]: </disk>
Aug 14 12:21:56 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:21:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:21:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:21:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] No VIF found with MAC fa:16:3e:2d:27:fb, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:21:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c7af8a9d-2b36-4bba-b608-3b7f7cfcf288 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.369s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:21:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:21:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:21:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:21:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Detaching volume 5f3545eb-d94c-4efe-9297-395a2283cf8b
Aug 14 12:21:59 user nova-compute[73012]: INFO nova.virt.block_device [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Attempting to driver detach volume 5f3545eb-d94c-4efe-9297-395a2283cf8b from mountpoint /dev/vdb
Aug 14 12:21:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Attempting to detach device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:21:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:21:59 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:21:59 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:21:59 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:21:59 user nova-compute[73012]:   <serial>5f3545eb-d94c-4efe-9297-395a2283cf8b</serial>
Aug 14 12:21:59 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:21:59 user nova-compute[73012]: </disk>
Aug 14 12:21:59 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:21:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully detached device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the persistent domain config.
Aug 14 12:21:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:21:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:21:59 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:21:59 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:21:59 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:21:59 user nova-compute[73012]:   <serial>5f3545eb-d94c-4efe-9297-395a2283cf8b</serial>
Aug 14 12:21:59 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:21:59 user nova-compute[73012]: </disk>
Aug 14 12:21:59 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015720.4329705, 8e51a9ce-cd61-4c43-a297-7f313bf2a07c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:22:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully detached device vdb from instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c from the live domain config.
Aug 14 12:22:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtocHBan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:22:00 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a1105-b2ac-4731-a1e7-5b541313dd7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f8fc0-9c57-42cb-a4ae-b5261569c8dd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:00 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:00 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:00 user nova-compute[73012]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b (non-flash)
Aug 14 12:22:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:00 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:00 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:00 user nova-compute[73012]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b (non-flash)
Aug 14 12:22:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aacf03d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fdbb3b-e214-40d1-b52f-6d181f0ce2c7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6708c32-4ff1-4c14-835f-be79e9871317]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[76be38a7-f0fb-48b4-9197-de2b774b91e5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8d9f7-b663-45db-829a-0af5c22fa0b5]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[433b13c0-0833-4ba8-b45f-7fe55c42d832]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[152171e6-8c53-4de3-8a57-839c14d25dd0]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b, portal: 172.16.0.220,3260]
Aug 14 12:22:00 user nova-compute[73012]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b, portal: 172.16.0.220,3260] successful.
Aug 14 12:22:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f3545eb-d94c-4efe-9297-395a2283cf8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0a87ac-900d-4e73-a215-35aefb5a275b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] <== disconnect_volume: return (344ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:22:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:22:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:04 user nova-compute[73012]: DEBUG nova.objects.instance [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'flavor' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:22:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b95e46a6-aee4-4f1d-b1ce-0fa3cedb58f9 tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.272s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFXIWsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:22:06 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:22:06 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:22:06 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29aa92a-62b2-4d68-a8ed-4de53d54d501]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:22:06 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebf546f-45bb-45c2-9158-d6d3928271ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a] added
Aug 14 12:22:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[424fa027-fde4-4912-bad0-e6482d402cbe]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17acb1-e610-47df-adde-4217325e000e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFXIWsSa {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFXIWsSa" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c355aed-ce70-499c-8899-dfd99b9eb692]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EFXIWsSa'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee3be26-61cf-4509-8b19-92c536c094fa]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67424a8-fdbf-41b5-8538-df7a94f46ce2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbb0d7e-07e7-491b-9628-a5e35c286522]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260]
Aug 14 12:22:06 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260] successful.
Aug 14 12:22:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[31262a71-649d-4f9b-b675-cbcacff22495]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8febb4-45ad-4cac-a232-79b2f972b57d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:22:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:06 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:22:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a672390-2c2e-41e4-b4d6-1b799c6e78eb]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFXIWsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26665313839653833', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665313839653833', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:22:07 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:22:07 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:22:07 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:22:07 user nova-compute[73012]:   <serial>1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a</serial>
Aug 14 12:22:07 user nova-compute[73012]: </disk>
Aug 14 12:22:07 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:22:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:22:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:22:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No VIF found with MAC fa:16:3e:08:4b:33, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:22:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dba9d434-c6dc-4ec6-84e0-46de1fac86f8 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.294s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c4760705-a443-4025-8e3b-942f8e035db4 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c4760705-a443-4025-8e3b-942f8e035db4 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c4760705-a443-4025-8e3b-942f8e035db4 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c4760705-a443-4025-8e3b-942f8e035db4 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73012) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c4760705-a443-4025-8e3b-942f8e035db4 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-992d5759-12e7-4147-b4cf-a0e8247cd418 req-8ab5e158-a48b-49f9-82ba-4a646e5ce20d service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-unplugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-992d5759-12e7-4147-b4cf-a0e8247cd418 req-8ab5e158-a48b-49f9-82ba-4a646e5ce20d service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-992d5759-12e7-4147-b4cf-a0e8247cd418 req-8ab5e158-a48b-49f9-82ba-4a646e5ce20d service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-992d5759-12e7-4147-b4cf-a0e8247cd418 req-8ab5e158-a48b-49f9-82ba-4a646e5ce20d service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-992d5759-12e7-4147-b4cf-a0e8247cd418 req-8ab5e158-a48b-49f9-82ba-4a646e5ce20d service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-unplugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:22:09 user nova-compute[73012]: WARNING nova.compute.manager [req-992d5759-12e7-4147-b4cf-a0e8247cd418 req-8ab5e158-a48b-49f9-82ba-4a646e5ce20d service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-unplugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state active and task_state powering-off.
Aug 14 12:22:09 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance destroyed successfully.
Aug 14 12:22:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c4760705-a443-4025-8e3b-942f8e035db4 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:22:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c4760705-a443-4025-8e3b-942f8e035db4 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.892s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-5d19ccce-6117-4fa3-ba87-b3af9a9e0ce4 req-3fff5bd4-18ea-4375-9177-156957f77b66 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5d19ccce-6117-4fa3-ba87-b3af9a9e0ce4 req-3fff5bd4-18ea-4375-9177-156957f77b66 service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5d19ccce-6117-4fa3-ba87-b3af9a9e0ce4 req-3fff5bd4-18ea-4375-9177-156957f77b66 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5d19ccce-6117-4fa3-ba87-b3af9a9e0ce4 req-3fff5bd4-18ea-4375-9177-156957f77b66 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-5d19ccce-6117-4fa3-ba87-b3af9a9e0ce4 req-3fff5bd4-18ea-4375-9177-156957f77b66 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:22:11 user nova-compute[73012]: WARNING nova.compute.manager [req-5d19ccce-6117-4fa3-ba87-b3af9a9e0ce4 req-3fff5bd4-18ea-4375-9177-156957f77b66 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state stopped and task_state None.
Aug 14 12:22:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-7ebfd42f-d52b-4b58-b9e2-aef9fb9488bd req-fb8a6e8f-316a-4926-8603-600d33d9c997 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received event network-changed-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-7ebfd42f-d52b-4b58-b9e2-aef9fb9488bd req-fb8a6e8f-316a-4926-8603-600d33d9c997 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Refreshing instance network info cache due to event network-changed-705f8ea2-972b-4194-ba28-1a16d9742dc4. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:22:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7ebfd42f-d52b-4b58-b9e2-aef9fb9488bd req-fb8a6e8f-316a-4926-8603-600d33d9c997 service nova] Acquiring lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:22:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7ebfd42f-d52b-4b58-b9e2-aef9fb9488bd req-fb8a6e8f-316a-4926-8603-600d33d9c997 service nova] Acquired lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:22:22 user nova-compute[73012]: DEBUG nova.network.neutron [req-7ebfd42f-d52b-4b58-b9e2-aef9fb9488bd req-fb8a6e8f-316a-4926-8603-600d33d9c997 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Refreshing network info cache for port 705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:22:22 user nova-compute[73012]: DEBUG nova.network.neutron [req-7ebfd42f-d52b-4b58-b9e2-aef9fb9488bd req-fb8a6e8f-316a-4926-8603-600d33d9c997 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updated VIF entry in instance network info cache for port 705f8ea2-972b-4194-ba28-1a16d9742dc4. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:22:22 user nova-compute[73012]: DEBUG nova.network.neutron [req-7ebfd42f-d52b-4b58-b9e2-aef9fb9488bd req-fb8a6e8f-316a-4926-8603-600d33d9c997 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updating instance_info_cache with network_info: [{"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:22:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7ebfd42f-d52b-4b58-b9e2-aef9fb9488bd req-fb8a6e8f-316a-4926-8603-600d33d9c997 service nova] Releasing lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:22:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:23 user nova-compute[73012]: INFO nova.compute.manager [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Terminating instance
Aug 14 12:22:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-20297763-807c-4643-b7fb-b8e4ae314d4f req-c9970d26-9a01-4a5c-91ba-24ff1b373e7c service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-unplugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-20297763-807c-4643-b7fb-b8e4ae314d4f req-c9970d26-9a01-4a5c-91ba-24ff1b373e7c service nova] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-20297763-807c-4643-b7fb-b8e4ae314d4f req-c9970d26-9a01-4a5c-91ba-24ff1b373e7c service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-20297763-807c-4643-b7fb-b8e4ae314d4f req-c9970d26-9a01-4a5c-91ba-24ff1b373e7c service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-20297763-807c-4643-b7fb-b8e4ae314d4f req-c9970d26-9a01-4a5c-91ba-24ff1b373e7c service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] No waiting events found dispatching network-vif-unplugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:22:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-20297763-807c-4643-b7fb-b8e4ae314d4f req-c9970d26-9a01-4a5c-91ba-24ff1b373e7c service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-unplugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:22:24 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Instance destroyed successfully.
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.objects.instance [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'resources' on Instance uuid 722de834-9535-4249-91b3-378e4b98f8e0 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2090819762',display_name='tempest-TestMinimumBasicScenario-server-2090819762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2090819762',id=27,image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/1P1r7AreTvEXXZhLTnEfr4e7XilrWGHn6/JEAVreeRFnynkXIX9PgsUZ+6qb9djMhPUPTX1LoegbIFijSORdeYf9w55P6fR3mWAuq6XBGe8VbYr5eZI8r1npC31ylAA==',key_name='tempest-TestMinimumBasicScenario-884270579',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3be304f15a542fc98ed7614001dd016',ramdisk_id='',reservation_id='r-brsox2q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a251c3cc-bd85-4597-9c67-c0b98d2f6b2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1379939828',owner_user_name='tempest-TestMinimumBasicScenario-1379939828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:19:41Z,user_data=None,user_id='0f89f51cc15e4ffb8860f42ddcb44ae1',uuid=722de834-9535-4249-91b3-378e4b98f8e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converting VIF {"id": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "address": "fa:16:3e:be:2f:08", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ba563f-c8", "ovs_interfaceid": "e0ba563f-c8ca-48c4-8954-be7f64edde26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG os_vif [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0ba563f-c8, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-6fd26ca9-1fc8-43da-9235-1bfa70ffdf6a req-6960a152-ab5c-4c68-ae6f-d43fe1c1589c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-changed-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-6fd26ca9-1fc8-43da-9235-1bfa70ffdf6a req-6960a152-ab5c-4c68-ae6f-d43fe1c1589c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Refreshing instance network info cache due to event network-changed-de4870b2-3985-4363-bdc8-364805f9568a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6fd26ca9-1fc8-43da-9235-1bfa70ffdf6a req-6960a152-ab5c-4c68-ae6f-d43fe1c1589c service nova] Acquiring lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6fd26ca9-1fc8-43da-9235-1bfa70ffdf6a req-6960a152-ab5c-4c68-ae6f-d43fe1c1589c service nova] Acquired lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.network.neutron [req-6fd26ca9-1fc8-43da-9235-1bfa70ffdf6a req-6960a152-ab5c-4c68-ae6f-d43fe1c1589c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Refreshing network info cache for port de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:24 user nova-compute[73012]: INFO os_vif [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:2f:08,bridge_name='br-int',has_traffic_filtering=True,id=e0ba563f-c8ca-48c4-8954-be7f64edde26,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ba563f-c8')
Aug 14 12:22:24 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Deleting instance files /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0_del
Aug 14 12:22:24 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Deletion of /opt/stack/data/nova/instances/722de834-9535-4249-91b3-378e4b98f8e0_del complete
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Stashing vm_state: active {{(pid=73012) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 12:22:24 user nova-compute[73012]: INFO nova.compute.manager [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'pci_requests' on Instance uuid 53ee2aff-68a4-4015-82b3-30e842115c79 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:22:24 user nova-compute[73012]: INFO nova.compute.claims [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Claim successful on node user
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'resources' on Instance uuid 53ee2aff-68a4-4015-82b3-30e842115c79 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'pci_devices' on Instance uuid 53ee2aff-68a4-4015-82b3-30e842115c79 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:22:24 user nova-compute[73012]: INFO nova.compute.resource_tracker [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating resource usage from migration 086bd170-0ba5-4d3f-9552-ad399b899b9f
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.494s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:24 user nova-compute[73012]: INFO nova.compute.manager [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Migrating
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:22:24 user nova-compute[73012]: INFO nova.compute.rpcapi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015729.858851, 56391331-dd5f-4641-8208-72ba5cd514a4 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:22:24 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] VM Stopped (Lifecycle Event)
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e67d1c57-b79b-4715-892e-3026c647736d None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e67d1c57-b79b-4715-892e-3026c647736d None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:22:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-6fd26ca9-1fc8-43da-9235-1bfa70ffdf6a req-6960a152-ab5c-4c68-ae6f-d43fe1c1589c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updated VIF entry in instance network info cache for port de4870b2-3985-4363-bdc8-364805f9568a. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-6fd26ca9-1fc8-43da-9235-1bfa70ffdf6a req-6960a152-ab5c-4c68-ae6f-d43fe1c1589c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating instance_info_cache with network_info: [{"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6fd26ca9-1fc8-43da-9235-1bfa70ffdf6a req-6960a152-ab5c-4c68-ae6f-d43fe1c1589c service nova] Releasing lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquired lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.network.neutron [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:22:25 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Took 1.02 seconds to deallocate network for instance.
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-63bad74e-b66f-4c88-9fe2-62474d384df0 req-e41f92c8-d943-46bf-810c-2008a852af12 service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-deleted-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.network.neutron [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating instance_info_cache with network_info: [{"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Releasing lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:25 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Deleted allocations for instance 722de834-9535-4249-91b3-378e4b98f8e0
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-826ed3f5-f940-40cc-8312-e0a8014a0154 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "722de834-9535-4249-91b3-378e4b98f8e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.473s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-09361c81-cae8-49e1-9c72-b103dd32bdfb req-3ffde3e0-2b81-492a-989d-b7dadb97e8af service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-09361c81-cae8-49e1-9c72-b103dd32bdfb req-3ffde3e0-2b81-492a-989d-b7dadb97e8af service nova] Acquiring lock "722de834-9535-4249-91b3-378e4b98f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-09361c81-cae8-49e1-9c72-b103dd32bdfb req-3ffde3e0-2b81-492a-989d-b7dadb97e8af service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-09361c81-cae8-49e1-9c72-b103dd32bdfb req-3ffde3e0-2b81-492a-989d-b7dadb97e8af service nova] Lock "722de834-9535-4249-91b3-378e4b98f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-09361c81-cae8-49e1-9c72-b103dd32bdfb req-3ffde3e0-2b81-492a-989d-b7dadb97e8af service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] No waiting events found dispatching network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:22:25 user nova-compute[73012]: WARNING nova.compute.manager [req-09361c81-cae8-49e1-9c72-b103dd32bdfb req-3ffde3e0-2b81-492a-989d-b7dadb97e8af service nova] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Received unexpected event network-vif-plugged-e0ba563f-c8ca-48c4-8954-be7f64edde26 for instance with vm_state deleted and task_state None.
Aug 14 12:22:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Starting migrate_disk_and_power_off {{(pid=73012) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 12:22:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Instance destroyed successfully.
Aug 14 12:22:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269061199',display_name='tempest-ServerActionsTestOtherA-server-1269061199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269061199',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFloYN1ReWoKPyBlc0SLCyu4ynKhd4hHFwk9GiyUMnITdI9Vxx2/nsK5EMWhGjgXLC4h+Dyjic41yKG1TsZ9FF3dSkrQKzlOkDc47k70qj4dK+sgWipPTYpvmqVW5R9Xg==',key_name='tempest-keypair-1585640726',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-2r7zlbth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=53ee2aff-68a4-4015-82b3-30e842115c79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-170270157-network", "vif_mac": "fa:16:3e:0f:c2:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-170270157-network", "vif_mac": "fa:16:3e:0f:c2:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_vif [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde4870b2-39, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:26 user nova-compute[73012]: INFO os_vif [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39')
Aug 14 12:22:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKYLRuEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:22:26 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a6e418-bfc2-4b40-9cb8-cfce92459915]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f431c29e-7de4-4bce-a771-2164e6cc24a2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:26 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:26 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:26 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:22:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:26 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:26 user nova-compute[73012]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:26 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:22:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad01689d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61'): ({'sdf'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Removing single pathed devices sdf {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b029b027-5c50-41f1-959d-7b74e31b1a8d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06c8cd4-ca26-4afa-a10e-92466dd7d570]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flushing IO for device /dev/sdf {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28fa1d9-153e-4f69-be9b-da7067f8d037]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[97973084-a1d7-479a-a718-9283f318597e]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] SCSI volumes sdf have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26231333638306439', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1b011b37', '/dev/disk/by-id/scsi-1SCST_BIO1b011b37-b13680d94489a234') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f1d320-6c7e-42f9-b456-ccd1f8f3e98c]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dff9ce0-d3c9-42d0-a113-85725927f5bf]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[59272e47-ad47-4baa-b716-0771384f1122]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260]
Aug 14 12:22:26 user nova-compute[73012]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260] successful.
Aug 14 12:22:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[86716a90-7687-456b-814b-ef573b346ee3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== disconnect_volume: return (311ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:22:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:22:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-unplugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] No waiting events found dispatching network-vif-unplugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:22:27 user nova-compute[73012]: WARNING nova.compute.manager [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received unexpected event network-vif-unplugged-de4870b2-3985-4363-bdc8-364805f9568a for instance with vm_state active and task_state resize_migrating.
Aug 14 12:22:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] No waiting events found dispatching network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:22:27 user nova-compute[73012]: WARNING nova.compute.manager [req-4b62b103-08b7-4552-8a1c-ee2dea1b8b64 req-fc27b947-853d-4ab2-8851-1a083de9608c service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received unexpected event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a for instance with vm_state active and task_state resize_migrating.
Aug 14 12:22:27 user nova-compute[73012]: DEBUG nova.network.neutron [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Port de4870b2-3985-4363-bdc8-364805f9568a binding to destination host user is already ACTIVE {{(pid=73012) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquired lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG nova.network.neutron [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG nova.network.neutron [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating instance_info_cache with network_info: [{"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Releasing lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG os_brick.utils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b81c64-f889-40c6-8576-f66337840b74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3af7d33-656c-40a8-99b3-70bc19a8a4ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d08e84-cdd0-43b9-a824-195cdf7ecd43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d233197-b531-4bf5-93fe-4bf3a41fae5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:22:28 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:22:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[84394c08-224a-41fb-afdf-bc47e8565517]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:22:28 user nova-compute[73012]: DEBUG os_brick.utils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 66fb72b1-30a9-4be2-b843-7d648fc66e16 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 85d8779d-a30a-46ea-b979-860584678597 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 53ee2aff-68a4-4015-82b3-30e842115c79 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid bf1c2e78-360e-43fe-96f9-46e9d3c030fc {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "85d8779d-a30a-46ea-b979-860584678597" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "85d8779d-a30a-46ea-b979-860584678597" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "53ee2aff-68a4-4015-82b3-30e842115c79" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: INFO nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "53ee2aff-68a4-4015-82b3-30e842115c79" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "85d8779d-a30a-46ea-b979-860584678597" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Starting finish_migration {{(pid=73012) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Instance directory exists: not creating {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 12:22:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Creating image(s)
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Ensure instance console log exists: /opt/stack/data/nova/instances/53ee2aff-68a4-4015-82b3-30e842115c79/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Start _get_guest_xml network_info=[{"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-170270157-network", "vif_mac": "fa:16:3e:0f:c2:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKYLRuEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '53ee2aff-68a4-4015-82b3-30e842115c79', 'attached_at': '2023-08-14T12:22:38.000000', 'detached_at': '', 'volume_id': '2283305a-807b-4e5e-afe8-8aa2346a3d61', 'serial': '2283305a-807b-4e5e-afe8-8aa2346a3d61'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '7301e4ea-701b-4222-869e-1138be0fa3dd', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:22:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:22:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53ee2aff-68a4-4015-82b3-30e842115c79 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKYLRuEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:22:37 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:22:37 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:22:37 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9025f0b1-215f-4d9e-87a9-7f085ba5c76e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:22:37 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4980c56-7a13-4d6e-ad9e-55ab865929ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61] added
Aug 14 12:22:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fc9a54-2f03-4913-9cb6-bc923eb438c4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[725eb6c9-04d6-4a15-8e19-f6d326fe0847]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKYLRuEN {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKYLRuEN" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9198e863-e2ea-408a-b338-03eba8e64238]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bKYLRuEN'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3d0221-ee3a-44d9-9959-4774671ec193]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a5e9b8-17cb-4204-a36e-db8076ed6559]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:37 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:37 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:22:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:37 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:37 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:22:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[909c19f7-f1c0-46c0-aff5-7d26b5be39cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260]
Aug 14 12:22:37 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260] successful.
Aug 14 12:22:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c694f2-20ac-42ba-9d63-73b020081fb4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eebe4d-0e3b-40e0-a904-b1f23519a1ef]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:38 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:38 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:22:38 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:38 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:22:38 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:22:38 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:22:38 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:22:38 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dd2aab-b281-4931-bf6d-a48c76b04402]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKYLRuEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26231333638306439', 'path': '/dev/sde'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231333638306439', 'path': '/dev/sde'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269061199',display_name='tempest-ServerActionsTestOtherA-server-1269061199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269061199',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFloYN1ReWoKPyBlc0SLCyu4ynKhd4hHFwk9GiyUMnITdI9Vxx2/nsK5EMWhGjgXLC4h+Dyjic41yKG1TsZ9FF3dSkrQKzlOkDc47k70qj4dK+sgWipPTYpvmqVW5R9Xg==',key_name='tempest-keypair-1585640726',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-2r7zlbth',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=53ee2aff-68a4-4015-82b3-30e842115c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-170270157-network", "vif_mac": "fa:16:3e:0f:c2:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-170270157-network", "vif_mac": "fa:16:3e:0f:c2:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:22:39 user nova-compute[73012]:   <uuid>53ee2aff-68a4-4015-82b3-30e842115c79</uuid>
Aug 14 12:22:39 user nova-compute[73012]:   <name>instance-0000001e</name>
Aug 14 12:22:39 user nova-compute[73012]:   <memory>2097152</memory>
Aug 14 12:22:39 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:22:39 user nova-compute[73012]:   <metadata>
Aug 14 12:22:39 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:22:39 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:22:39 user nova-compute[73012]:       <nova:name>tempest-ServerActionsTestOtherA-server-1269061199</nova:name>
Aug 14 12:22:39 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:22:37</nova:creationTime>
Aug 14 12:22:39 user nova-compute[73012]:       <nova:flavor name="m1.small">
Aug 14 12:22:39 user nova-compute[73012]:         <nova:memory>2048</nova:memory>
Aug 14 12:22:39 user nova-compute[73012]:         <nova:disk>20</nova:disk>
Aug 14 12:22:39 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:22:39 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:22:39 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:22:39 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:22:39 user nova-compute[73012]:       <nova:owner>
Aug 14 12:22:39 user nova-compute[73012]:         <nova:user uuid="7d6c467aee6140bda719332345af7ec0">tempest-ServerActionsTestOtherA-975401032-project-member</nova:user>
Aug 14 12:22:39 user nova-compute[73012]:         <nova:project uuid="33d5064d145e48eab20dc7ee82bdf779">tempest-ServerActionsTestOtherA-975401032</nova:project>
Aug 14 12:22:39 user nova-compute[73012]:       </nova:owner>
Aug 14 12:22:39 user nova-compute[73012]:       <nova:ports>
Aug 14 12:22:39 user nova-compute[73012]:         <nova:port uuid="de4870b2-3985-4363-bdc8-364805f9568a">
Aug 14 12:22:39 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:22:39 user nova-compute[73012]:         </nova:port>
Aug 14 12:22:39 user nova-compute[73012]:       </nova:ports>
Aug 14 12:22:39 user nova-compute[73012]:     </nova:instance>
Aug 14 12:22:39 user nova-compute[73012]:   </metadata>
Aug 14 12:22:39 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:22:39 user nova-compute[73012]:     <system>
Aug 14 12:22:39 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:22:39 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:22:39 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:22:39 user nova-compute[73012]:       <entry name="serial">53ee2aff-68a4-4015-82b3-30e842115c79</entry>
Aug 14 12:22:39 user nova-compute[73012]:       <entry name="uuid">53ee2aff-68a4-4015-82b3-30e842115c79</entry>
Aug 14 12:22:39 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:22:39 user nova-compute[73012]:     </system>
Aug 14 12:22:39 user nova-compute[73012]:   </sysinfo>
Aug 14 12:22:39 user nova-compute[73012]:   <os>
Aug 14 12:22:39 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:22:39 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:22:39 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:22:39 user nova-compute[73012]:   </os>
Aug 14 12:22:39 user nova-compute[73012]:   <features>
Aug 14 12:22:39 user nova-compute[73012]:     <acpi/>
Aug 14 12:22:39 user nova-compute[73012]:     <apic/>
Aug 14 12:22:39 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:22:39 user nova-compute[73012]:   </features>
Aug 14 12:22:39 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:22:39 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:22:39 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:22:39 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:22:39 user nova-compute[73012]:   </clock>
Aug 14 12:22:39 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:22:39 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:22:39 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:22:39 user nova-compute[73012]:   </cpu>
Aug 14 12:22:39 user nova-compute[73012]:   <devices>
Aug 14 12:22:39 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:22:39 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:22:39 user nova-compute[73012]:       <source dev="/dev/sde"/>
Aug 14 12:22:39 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:22:39 user nova-compute[73012]:       <serial>2283305a-807b-4e5e-afe8-8aa2346a3d61</serial>
Aug 14 12:22:39 user nova-compute[73012]:     </disk>
Aug 14 12:22:39 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:22:39 user nova-compute[73012]:       <mac address="fa:16:3e:0f:c2:c2"/>
Aug 14 12:22:39 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:22:39 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:22:39 user nova-compute[73012]:       <target dev="tapde4870b2-39"/>
Aug 14 12:22:39 user nova-compute[73012]:     </interface>
Aug 14 12:22:39 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:22:39 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/53ee2aff-68a4-4015-82b3-30e842115c79/console.log" append="off"/>
Aug 14 12:22:39 user nova-compute[73012]:     </serial>
Aug 14 12:22:39 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:22:39 user nova-compute[73012]:     <video>
Aug 14 12:22:39 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:22:39 user nova-compute[73012]:     </video>
Aug 14 12:22:39 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:22:39 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:22:39 user nova-compute[73012]:     </rng>
Aug 14 12:22:39 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:22:39 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:22:39 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:22:39 user nova-compute[73012]:     </memballoon>
Aug 14 12:22:39 user nova-compute[73012]:   </devices>
Aug 14 12:22:39 user nova-compute[73012]: </domain>
Aug 14 12:22:39 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269061199',display_name='tempest-ServerActionsTestOtherA-server-1269061199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269061199',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFloYN1ReWoKPyBlc0SLCyu4ynKhd4hHFwk9GiyUMnITdI9Vxx2/nsK5EMWhGjgXLC4h+Dyjic41yKG1TsZ9FF3dSkrQKzlOkDc47k70qj4dK+sgWipPTYpvmqVW5R9Xg==',key_name='tempest-keypair-1585640726',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-2r7zlbth',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=53ee2aff-68a4-4015-82b3-30e842115c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-170270157-network", "vif_mac": "fa:16:3e:0f:c2:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-170270157-network", "vif_mac": "fa:16:3e:0f:c2:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG os_vif [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde4870b2-39, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde4870b2-39, col_values=(('external_ids', {'iface-id': 'de4870b2-3985-4363-bdc8-364805f9568a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:c2:c2', 'vm-uuid': '53ee2aff-68a4-4015-82b3-30e842115c79'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:39 user nova-compute[73012]: INFO os_vif [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39')
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015744.148036, 722de834-9535-4249-91b3-378e4b98f8e0 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:22:39 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] VM Stopped (Lifecycle Event)
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-eeb527dc-70ef-4a5e-ace0-3fb041a09fad None None] [instance: 722de834-9535-4249-91b3-378e4b98f8e0] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] No VIF found with MAC fa:16:3e:0f:c2:c2, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:39 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:22:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-fc3b9aec-92c0-4ed2-8dc4-cf41dd36e267 req-7052870b-baad-4483-88ab-11b722c7bd42 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fc3b9aec-92c0-4ed2-8dc4-cf41dd36e267 req-7052870b-baad-4483-88ab-11b722c7bd42 service nova] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fc3b9aec-92c0-4ed2-8dc4-cf41dd36e267 req-7052870b-baad-4483-88ab-11b722c7bd42 service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fc3b9aec-92c0-4ed2-8dc4-cf41dd36e267 req-7052870b-baad-4483-88ab-11b722c7bd42 service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-fc3b9aec-92c0-4ed2-8dc4-cf41dd36e267 req-7052870b-baad-4483-88ab-11b722c7bd42 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] No waiting events found dispatching network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:22:40 user nova-compute[73012]: WARNING nova.compute.manager [req-fc3b9aec-92c0-4ed2-8dc4-cf41dd36e267 req-7052870b-baad-4483-88ab-11b722c7bd42 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received unexpected event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a for instance with vm_state active and task_state resize_finish.
Aug 14 12:22:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015746.6088953, 53ee2aff-68a4-4015-82b3-30e842115c79 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:22:41 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] VM Stopped (Lifecycle Event)
Aug 14 12:22:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08a6057b-d89a-41f6-8802-e7394de8a569 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:22:42 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Instance running successfully.
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Failed to set time: agent not configured {{(pid=73012) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f9140623-4ac6-4026-9ece-c6128899fea9 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] finish_migration finished successfully. {{(pid=73012) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015762.5741427, 53ee2aff-68a4-4015-82b3-30e842115c79 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:22:42 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] VM Resumed (Lifecycle Event)
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:42 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015762.575816, 53ee2aff-68a4-4015-82b3-30e842115c79 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:22:42 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] VM Started (Lifecycle Event)
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:22:42 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-7e9ec001-9a9b-4ab6-b8e9-ebc2961e7c9b req-308b638d-6870-4ff7-9661-250698ea4c9e service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7e9ec001-9a9b-4ab6-b8e9-ebc2961e7c9b req-308b638d-6870-4ff7-9661-250698ea4c9e service nova] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7e9ec001-9a9b-4ab6-b8e9-ebc2961e7c9b req-308b638d-6870-4ff7-9661-250698ea4c9e service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7e9ec001-9a9b-4ab6-b8e9-ebc2961e7c9b req-308b638d-6870-4ff7-9661-250698ea4c9e service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-7e9ec001-9a9b-4ab6-b8e9-ebc2961e7c9b req-308b638d-6870-4ff7-9661-250698ea4c9e service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] No waiting events found dispatching network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:22:42 user nova-compute[73012]: WARNING nova.compute.manager [req-7e9ec001-9a9b-4ab6-b8e9-ebc2961e7c9b req-308b638d-6870-4ff7-9661-250698ea4c9e service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received unexpected event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a for instance with vm_state resized and task_state None.
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:22:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:22:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:22:44 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:22:44 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:22:44 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7717MB free_disk=25.274147033691406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:22:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:22:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Applying migration context for instance 53ee2aff-68a4-4015-82b3-30e842115c79 as it has an incoming, in-progress migration 086bd170-0ba5-4d3f-9552-ad399b899b9f. Migration status is finished {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 12:22:45 user nova-compute[73012]: INFO nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating resource usage from migration 086bd170-0ba5-4d3f-9552-ad399b899b9f
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 56391331-dd5f-4641-8208-72ba5cd514a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Migration 086bd170-0ba5-4d3f-9552-ad399b899b9f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 53ee2aff-68a4-4015-82b3-30e842115c79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:22:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:47 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:22:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:22:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:22:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:22:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updating instance_info_cache with network_info: [{"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:22:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:22:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:22:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:22:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:22:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:22:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:22:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:22:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:22:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:22:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:23:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:17 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:23:17 user nova-compute[73012]: INFO nova.compute.claims [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Claim successful on node user
Aug 14 12:23:18 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:23:18 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:23:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG nova.policy [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f89f51cc15e4ffb8860f42ddcb44ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3be304f15a542fc98ed7614001dd016', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:23:18 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Creating image(s)
Aug 14 12:23:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "/opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "/opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "2f7a2ce59bb0b5cf523817da4b400625e83a38a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "2f7a2ce59bb0b5cf523817da4b400625e83a38a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9.part --force-share --output=json" returned: 0 in 0.204s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG nova.virt.images [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] a3e6c7f0-08c4-4fcd-b4b4-7770610a0306 was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9.part /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Successfully created port: 5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9.part /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9.converted" returned: 0 in 0.154s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:19 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "2f7a2ce59bb0b5cf523817da4b400625e83a38a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.347s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9 --force-share --output=json" returned: 0 in 0.214s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "2f7a2ce59bb0b5cf523817da4b400625e83a38a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "2f7a2ce59bb0b5cf523817da4b400625e83a38a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9 --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9,backing_fmt=raw /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9,backing_fmt=raw /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk 1073741824" returned: 0 in 0.053s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "2f7a2ce59bb0b5cf523817da4b400625e83a38a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Successfully updated port: 5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquired lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9 --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-5be98ade-eafc-49c8-af3b-bb2be45bf85f req-67209b5b-4d31-4416-9a35-76cda96975c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-5be98ade-eafc-49c8-af3b-bb2be45bf85f req-67209b5b-4d31-4416-9a35-76cda96975c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing instance network info cache due to event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5be98ade-eafc-49c8-af3b-bb2be45bf85f req-67209b5b-4d31-4416-9a35-76cda96975c3 service nova] Acquiring lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Cannot resize image /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'migration_context' on Instance uuid e9be3988-9ba7-448b-b901-19e8aff1fe6a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Ensure instance console log exists: /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updating instance_info_cache with network_info: [{"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Releasing lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Instance network_info: |[{"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5be98ade-eafc-49c8-af3b-bb2be45bf85f req-67209b5b-4d31-4416-9a35-76cda96975c3 service nova] Acquired lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.network.neutron [req-5be98ade-eafc-49c8-af3b-bb2be45bf85f req-67209b5b-4d31-4416-9a35-76cda96975c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Start _get_guest_xml network_info=[{"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:23:15Z,direct_url=<?>,disk_format='qcow2',id=a3e6c7f0-08c4-4fcd-b4b4-7770610a0306,min_disk=0,min_ram=0,name='tempest-scenario-img--1992268114',owner='b3be304f15a542fc98ed7614001dd016',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:23:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'a3e6c7f0-08c4-4fcd-b4b4-7770610a0306'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:23:21 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:23:21 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:23:15Z,direct_url=<?>,disk_format='qcow2',id=a3e6c7f0-08c4-4fcd-b4b4-7770610a0306,min_disk=0,min_ram=0,name='tempest-scenario-img--1992268114',owner='b3be304f15a542fc98ed7614001dd016',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:23:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:23:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-532113124',display_name='tempest-TestMinimumBasicScenario-server-532113124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-532113124',id=32,image_ref='a3e6c7f0-08c4-4fcd-b4b4-7770610a0306',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzVMNcK3ErlmSyE588RmpHmp/E+mxAI+719u3hBwu5NGIz3NOqKloCIju6pe4yTf4PZQqtcHy7mnwxHxQLOzW/qQ7NqlIljMIGn5sn8gSFdFMlzFFGyZfVAL0OgVtXzZQ==',key_name='tempest-TestMinimumBasicScenario-1641617657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3be304f15a542fc98ed7614001dd016',ramdisk_id='',reservation_id='r-qn48f2z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a3e6c7f0-08c4-4fcd-b4b4-7770610a0306',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1379939828',owner_user_name='tempest-TestMinimumBasicScenario-1379939828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:23:19Z,user_data=None,user_id='0f89f51cc15e4ffb8860f42ddcb44ae1',uuid=e9be3988-9ba7-448b-b901-19e8aff1fe6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converting VIF {"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:53:2f,bridge_name='br-int',has_traffic_filtering=True,id=5fa0791e-115a-4d36-8152-68c0b1cdaed9,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa0791e-11') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'pci_devices' on Instance uuid e9be3988-9ba7-448b-b901-19e8aff1fe6a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:23:21 user nova-compute[73012]:   <uuid>e9be3988-9ba7-448b-b901-19e8aff1fe6a</uuid>
Aug 14 12:23:21 user nova-compute[73012]:   <name>instance-00000020</name>
Aug 14 12:23:21 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:23:21 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:23:21 user nova-compute[73012]:   <metadata>
Aug 14 12:23:21 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:23:21 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:23:21 user nova-compute[73012]:       <nova:name>tempest-TestMinimumBasicScenario-server-532113124</nova:name>
Aug 14 12:23:21 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:23:21</nova:creationTime>
Aug 14 12:23:21 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:23:21 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:23:21 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:23:21 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:23:21 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:23:21 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:23:21 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:23:21 user nova-compute[73012]:       <nova:owner>
Aug 14 12:23:21 user nova-compute[73012]:         <nova:user uuid="0f89f51cc15e4ffb8860f42ddcb44ae1">tempest-TestMinimumBasicScenario-1379939828-project-member</nova:user>
Aug 14 12:23:21 user nova-compute[73012]:         <nova:project uuid="b3be304f15a542fc98ed7614001dd016">tempest-TestMinimumBasicScenario-1379939828</nova:project>
Aug 14 12:23:21 user nova-compute[73012]:       </nova:owner>
Aug 14 12:23:21 user nova-compute[73012]:       <nova:root type="image" uuid="a3e6c7f0-08c4-4fcd-b4b4-7770610a0306"/>
Aug 14 12:23:21 user nova-compute[73012]:       <nova:ports>
Aug 14 12:23:21 user nova-compute[73012]:         <nova:port uuid="5fa0791e-115a-4d36-8152-68c0b1cdaed9">
Aug 14 12:23:21 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 12:23:21 user nova-compute[73012]:         </nova:port>
Aug 14 12:23:21 user nova-compute[73012]:       </nova:ports>
Aug 14 12:23:21 user nova-compute[73012]:     </nova:instance>
Aug 14 12:23:21 user nova-compute[73012]:   </metadata>
Aug 14 12:23:21 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:23:21 user nova-compute[73012]:     <system>
Aug 14 12:23:21 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:23:21 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:23:21 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:23:21 user nova-compute[73012]:       <entry name="serial">e9be3988-9ba7-448b-b901-19e8aff1fe6a</entry>
Aug 14 12:23:21 user nova-compute[73012]:       <entry name="uuid">e9be3988-9ba7-448b-b901-19e8aff1fe6a</entry>
Aug 14 12:23:21 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:23:21 user nova-compute[73012]:     </system>
Aug 14 12:23:21 user nova-compute[73012]:   </sysinfo>
Aug 14 12:23:21 user nova-compute[73012]:   <os>
Aug 14 12:23:21 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:23:21 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:23:21 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:23:21 user nova-compute[73012]:   </os>
Aug 14 12:23:21 user nova-compute[73012]:   <features>
Aug 14 12:23:21 user nova-compute[73012]:     <acpi/>
Aug 14 12:23:21 user nova-compute[73012]:     <apic/>
Aug 14 12:23:21 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:23:21 user nova-compute[73012]:   </features>
Aug 14 12:23:21 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:23:21 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:23:21 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:23:21 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:23:21 user nova-compute[73012]:   </clock>
Aug 14 12:23:21 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:23:21 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:23:21 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:23:21 user nova-compute[73012]:   </cpu>
Aug 14 12:23:21 user nova-compute[73012]:   <devices>
Aug 14 12:23:21 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:23:21 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:23:21 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk"/>
Aug 14 12:23:21 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:23:21 user nova-compute[73012]:     </disk>
Aug 14 12:23:21 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:23:21 user nova-compute[73012]:       <mac address="fa:16:3e:45:53:2f"/>
Aug 14 12:23:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:23:21 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:23:21 user nova-compute[73012]:       <target dev="tap5fa0791e-11"/>
Aug 14 12:23:21 user nova-compute[73012]:     </interface>
Aug 14 12:23:21 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:23:21 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/console.log" append="off"/>
Aug 14 12:23:21 user nova-compute[73012]:     </serial>
Aug 14 12:23:21 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:23:21 user nova-compute[73012]:     <video>
Aug 14 12:23:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:23:21 user nova-compute[73012]:     </video>
Aug 14 12:23:21 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:23:21 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:23:21 user nova-compute[73012]:     </rng>
Aug 14 12:23:21 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:23:21 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:23:21 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:23:21 user nova-compute[73012]:     </memballoon>
Aug 14 12:23:21 user nova-compute[73012]:   </devices>
Aug 14 12:23:21 user nova-compute[73012]: </domain>
Aug 14 12:23:21 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:23:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-532113124',display_name='tempest-TestMinimumBasicScenario-server-532113124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-532113124',id=32,image_ref='a3e6c7f0-08c4-4fcd-b4b4-7770610a0306',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzVMNcK3ErlmSyE588RmpHmp/E+mxAI+719u3hBwu5NGIz3NOqKloCIju6pe4yTf4PZQqtcHy7mnwxHxQLOzW/qQ7NqlIljMIGn5sn8gSFdFMlzFFGyZfVAL0OgVtXzZQ==',key_name='tempest-TestMinimumBasicScenario-1641617657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3be304f15a542fc98ed7614001dd016',ramdisk_id='',reservation_id='r-qn48f2z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a3e6c7f0-08c4-4fcd-b4b4-7770610a0306',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1379939828',owner_user_name='tempest-TestMinimumBasicScenario-1379939828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:23:19Z,user_data=None,user_id='0f89f51cc15e4ffb8860f42ddcb44ae1',uuid=e9be3988-9ba7-448b-b901-19e8aff1fe6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converting VIF {"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:53:2f,bridge_name='br-int',has_traffic_filtering=True,id=5fa0791e-115a-4d36-8152-68c0b1cdaed9,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa0791e-11') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG os_vif [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:53:2f,bridge_name='br-int',has_traffic_filtering=True,id=5fa0791e-115a-4d36-8152-68c0b1cdaed9,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa0791e-11') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fa0791e-11, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fa0791e-11, col_values=(('external_ids', {'iface-id': '5fa0791e-115a-4d36-8152-68c0b1cdaed9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:53:2f', 'vm-uuid': 'e9be3988-9ba7-448b-b901-19e8aff1fe6a'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:21 user nova-compute[73012]: INFO os_vif [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:53:2f,bridge_name='br-int',has_traffic_filtering=True,id=5fa0791e-115a-4d36-8152-68c0b1cdaed9,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa0791e-11')
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No VIF found with MAC fa:16:3e:45:53:2f, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.network.neutron [req-5be98ade-eafc-49c8-af3b-bb2be45bf85f req-67209b5b-4d31-4416-9a35-76cda96975c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updated VIF entry in instance network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG nova.network.neutron [req-5be98ade-eafc-49c8-af3b-bb2be45bf85f req-67209b5b-4d31-4416-9a35-76cda96975c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updating instance_info_cache with network_info: [{"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:23:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5be98ade-eafc-49c8-af3b-bb2be45bf85f req-67209b5b-4d31-4416-9a35-76cda96975c3 service nova] Releasing lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:23:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-724398a7-cd98-4369-a9a0-30cfd316636f req-c81a9220-de1b-4766-a510-7a5192173263 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:23:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-724398a7-cd98-4369-a9a0-30cfd316636f req-c81a9220-de1b-4766-a510-7a5192173263 service nova] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-724398a7-cd98-4369-a9a0-30cfd316636f req-c81a9220-de1b-4766-a510-7a5192173263 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-724398a7-cd98-4369-a9a0-30cfd316636f req-c81a9220-de1b-4766-a510-7a5192173263 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-724398a7-cd98-4369-a9a0-30cfd316636f req-c81a9220-de1b-4766-a510-7a5192173263 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] No waiting events found dispatching network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:23:23 user nova-compute[73012]: WARNING nova.compute.manager [req-724398a7-cd98-4369-a9a0-30cfd316636f req-c81a9220-de1b-4766-a510-7a5192173263 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received unexpected event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 for instance with vm_state building and task_state spawning.
Aug 14 12:23:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015804.945068, e9be3988-9ba7-448b-b901-19e8aff1fe6a => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:23:24 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] VM Resumed (Lifecycle Event)
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:23:24 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Instance spawned successfully.
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:23:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:23:24 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:23:25 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015804.9486547, e9be3988-9ba7-448b-b901-19e8aff1fe6a => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:23:25 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] VM Started (Lifecycle Event)
Aug 14 12:23:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:23:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:23:25 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:23:25 user nova-compute[73012]: INFO nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 14 12:23:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:23:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-4d909ccb-14f1-4ed4-8021-9a1361e2b68a req-3108e6be-be8d-4088-a665-f9ac8ad283a7 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:23:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4d909ccb-14f1-4ed4-8021-9a1361e2b68a req-3108e6be-be8d-4088-a665-f9ac8ad283a7 service nova] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4d909ccb-14f1-4ed4-8021-9a1361e2b68a req-3108e6be-be8d-4088-a665-f9ac8ad283a7 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4d909ccb-14f1-4ed4-8021-9a1361e2b68a req-3108e6be-be8d-4088-a665-f9ac8ad283a7 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-4d909ccb-14f1-4ed4-8021-9a1361e2b68a req-3108e6be-be8d-4088-a665-f9ac8ad283a7 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] No waiting events found dispatching network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:23:25 user nova-compute[73012]: WARNING nova.compute.manager [req-4d909ccb-14f1-4ed4-8021-9a1361e2b68a req-3108e6be-be8d-4088-a665-f9ac8ad283a7 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received unexpected event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 for instance with vm_state building and task_state spawning.
Aug 14 12:23:25 user nova-compute[73012]: INFO nova.compute.manager [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Took 7.21 seconds to build instance.
Aug 14 12:23:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d17da73c-9a16-40cd-930d-6bd922c1f24b tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.333s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:34 user nova-compute[73012]: INFO nova.compute.manager [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Terminating instance
Aug 14 12:23:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-d1baa876-44d5-46eb-84f3-41612e61d5e9 req-00ef4716-37a6-4cd8-bc6c-685ba3448ae5 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received event network-vif-unplugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d1baa876-44d5-46eb-84f3-41612e61d5e9 req-00ef4716-37a6-4cd8-bc6c-685ba3448ae5 service nova] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d1baa876-44d5-46eb-84f3-41612e61d5e9 req-00ef4716-37a6-4cd8-bc6c-685ba3448ae5 service nova] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d1baa876-44d5-46eb-84f3-41612e61d5e9 req-00ef4716-37a6-4cd8-bc6c-685ba3448ae5 service nova] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-d1baa876-44d5-46eb-84f3-41612e61d5e9 req-00ef4716-37a6-4cd8-bc6c-685ba3448ae5 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] No waiting events found dispatching network-vif-unplugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-d1baa876-44d5-46eb-84f3-41612e61d5e9 req-00ef4716-37a6-4cd8-bc6c-685ba3448ae5 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received event network-vif-unplugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:23:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:23:34 user nova-compute[73012]: INFO nova.compute.manager [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] instance snapshotting
Aug 14 12:23:34 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Beginning live snapshot process
Aug 14 12:23:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json -f qcow2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Instance destroyed successfully.
Aug 14 12:23:35 user nova-compute[73012]: DEBUG nova.objects.instance [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lazy-loading 'resources' on Instance uuid 8e51a9ce-cd61-4c43-a297-7f313bf2a07c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1326648969',display_name='tempest-SnapshotDataIntegrityTests-server-1326648969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1326648969',id=25,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQMndKv1VMriU6eBduh40Gs2PBgxe+7X/0vmDPO7Pn9jFjlMp0BXAfYJTLA++HLigmGzmXaVtxQM5sxPNSoIn/zInQjij59mIl7V6s/sSFFGVsc9tUWX3qzkBcGKUCAlQ==',key_name='tempest-keypair-1675037495',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0feef8d407c74fd092548ee5ffc0afda',ramdisk_id='',reservation_id='r-z1yychxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-367344780',owner_user_name='tempest-SnapshotDataIntegrityTests-367344780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec55f1fbed1454897cf3728940769aa',uuid=8e51a9ce-cd61-4c43-a297-7f313bf2a07c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Converting VIF {"id": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "address": "fa:16:3e:2d:27:fb", "network": {"id": "8e23759d-a738-434d-93a0-da729ce1a4ed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1465238915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0feef8d407c74fd092548ee5ffc0afda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0c43af-6f", "ovs_interfaceid": "2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a,network=Network(8e23759d-a738-434d-93a0-da729ce1a4ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0c43af-6f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG os_vif [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a,network=Network(8e23759d-a738-434d-93a0-da729ce1a4ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0c43af-6f') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a0c43af-6f, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:35 user nova-compute[73012]: INFO os_vif [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a,network=Network(8e23759d-a738-434d-93a0-da729ce1a4ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0c43af-6f')
Aug 14 12:23:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Deleting instance files /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c_del
Aug 14 12:23:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Deletion of /opt/stack/data/nova/instances/8e51a9ce-cd61-4c43-a297-7f313bf2a07c_del complete
Aug 14 12:23:35 user nova-compute[73012]: INFO nova.compute.manager [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 12:23:35 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json -f qcow2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7dcyz025/cbf1f346a4cc4c12b98688d6f951fdaa.delta 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7dcyz025/cbf1f346a4cc4c12b98688d6f951fdaa.delta 1073741824" returned: 0 in 0.055s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 12:23:36 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:23:36 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Took 0.97 seconds to deallocate network for instance.
Aug 14 12:23:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-e12c5b0a-f21d-4d94-ba6a-d2e824feb997 req-bbab7cfe-a14a-40c8-82e3-ad033fd15630 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received event network-vif-plugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e12c5b0a-f21d-4d94-ba6a-d2e824feb997 req-bbab7cfe-a14a-40c8-82e3-ad033fd15630 service nova] Acquiring lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e12c5b0a-f21d-4d94-ba6a-d2e824feb997 req-bbab7cfe-a14a-40c8-82e3-ad033fd15630 service nova] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e12c5b0a-f21d-4d94-ba6a-d2e824feb997 req-bbab7cfe-a14a-40c8-82e3-ad033fd15630 service nova] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-e12c5b0a-f21d-4d94-ba6a-d2e824feb997 req-bbab7cfe-a14a-40c8-82e3-ad033fd15630 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] No waiting events found dispatching network-vif-plugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:23:36 user nova-compute[73012]: WARNING nova.compute.manager [req-e12c5b0a-f21d-4d94-ba6a-d2e824feb997 req-bbab7cfe-a14a-40c8-82e3-ad033fd15630 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received unexpected event network-vif-plugged-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a for instance with vm_state deleted and task_state None.
Aug 14 12:23:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-e12c5b0a-f21d-4d94-ba6a-d2e824feb997 req-bbab7cfe-a14a-40c8-82e3-ad033fd15630 service nova] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Received event network-vif-deleted-2a0c43af-6fc3-42fd-8c34-7f1148ab4f0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:23:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:37 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Deleted allocations for instance 8e51a9ce-cd61-4c43-a297-7f313bf2a07c
Aug 14 12:23:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:23:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 12:23:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-409199c9-a6ea-478f-a912-012dee73364b tempest-SnapshotDataIntegrityTests-367344780 tempest-SnapshotDataIntegrityTests-367344780-project-member] Lock "8e51a9ce-cd61-4c43-a297-7f313bf2a07c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.754s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:37 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:23:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7dcyz025/cbf1f346a4cc4c12b98688d6f951fdaa.delta /opt/stack/data/nova/instances/snapshots/tmp7dcyz025/cbf1f346a4cc4c12b98688d6f951fdaa {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:38 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7dcyz025/cbf1f346a4cc4c12b98688d6f951fdaa.delta /opt/stack/data/nova/instances/snapshots/tmp7dcyz025/cbf1f346a4cc4c12b98688d6f951fdaa" returned: 0 in 0.802s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:38 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Snapshot extracted, beginning image upload
Aug 14 12:23:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Snapshot image upload complete
Aug 14 12:23:40 user nova-compute[73012]: INFO nova.compute.manager [None req-8f4dfaa5-b66e-41d1-bb8d-a5d3b6ac7bf2 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Took 5.60 seconds to snapshot the instance on the hypervisor.
Aug 14 12:23:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-8f7a0294-6442-42cb-b944-42271a1d75e2 req-fc66bd0e-5bf1-4216-ad66-3b05be153118 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-changed-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-8f7a0294-6442-42cb-b944-42271a1d75e2 req-fc66bd0e-5bf1-4216-ad66-3b05be153118 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Refreshing instance network info cache due to event network-changed-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8f7a0294-6442-42cb-b944-42271a1d75e2 req-fc66bd0e-5bf1-4216-ad66-3b05be153118 service nova] Acquiring lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8f7a0294-6442-42cb-b944-42271a1d75e2 req-fc66bd0e-5bf1-4216-ad66-3b05be153118 service nova] Acquired lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG nova.network.neutron [req-8f7a0294-6442-42cb-b944-42271a1d75e2 req-fc66bd0e-5bf1-4216-ad66-3b05be153118 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Refreshing network info cache for port 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:42 user nova-compute[73012]: INFO nova.compute.manager [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Detaching volume c44c073a-8324-434f-9e9b-f2e467db3867
Aug 14 12:23:42 user nova-compute[73012]: INFO nova.virt.block_device [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Attempting to driver detach volume c44c073a-8324-434f-9e9b-f2e467db3867 from mountpoint /dev/vdb
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Attempting to detach device vdb from instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:23:42 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:23:42 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:23:42 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:23:42 user nova-compute[73012]:   <serial>c44c073a-8324-434f-9e9b-f2e467db3867</serial>
Aug 14 12:23:42 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:23:42 user nova-compute[73012]: </disk>
Aug 14 12:23:42 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:23:42 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Successfully detached device vdb from instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 from the persistent domain config.
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:23:42 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:23:42 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:23:42 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:23:42 user nova-compute[73012]:   <serial>c44c073a-8324-434f-9e9b-f2e467db3867</serial>
Aug 14 12:23:42 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:23:42 user nova-compute[73012]: </disk>
Aug 14 12:23:42 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-8f7a0294-6442-42cb-b944-42271a1d75e2 req-fc66bd0e-5bf1-4216-ad66-3b05be153118 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updated VIF entry in instance network info cache for port 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-8f7a0294-6442-42cb-b944-42271a1d75e2 req-fc66bd0e-5bf1-4216-ad66-3b05be153118 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updating instance_info_cache with network_info: [{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8f7a0294-6442-42cb-b944-42271a1d75e2 req-fc66bd0e-5bf1-4216-ad66-3b05be153118 service nova] Releasing lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015822.8566782, 73fcc85e-48fd-486b-bda8-61d834d8cb42 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:23:42 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Successfully detached device vdb from instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 from the live domain config.
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deYWGkiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:23:42 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:23:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04422d7-f938-47ae-ada7-443e3d86dffa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e462a5-980d-403c-8f5e-6c17f74d17fe]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:23:42 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:23:42 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:23:42 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:23:42 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:23:42 user nova-compute[73012]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 (non-flash)
Aug 14 12:23:42 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:23:42 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:23:42 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad016b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a0e22-f20a-4f53-b468-1520b5f24fe7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:23:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfd5273-a4e8-4277-a3c4-6a0e03a07931]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a6e493-5ec2-4e33-ab82-4fe6be0f4350]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec2d3b9-a515-494e-bb6c-dd4bf625bfac]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[147a0c13-c982-4404-a740-93fddb299cf5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef99af4-35d6-4737-aee8-4a4917ecbda8]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867, portal: 172.16.0.220,3260]
Aug 14 12:23:43 user nova-compute[73012]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867, portal: 172.16.0.220,3260] successful.
Aug 14 12:23:43 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c44c073a-8324-434f-9e9b-f2e467db3867 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7183c760-ce4c-4309-9250-3b85b9717beb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] <== disconnect_volume: return (360ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-15dd604c-a799-4ab2-a4e3-7e6d939abee7 req-fcd54c37-d394-4abd-863b-d3c2d6269a23 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-changed-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-15dd604c-a799-4ab2-a4e3-7e6d939abee7 req-fcd54c37-d394-4abd-863b-d3c2d6269a23 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Refreshing instance network info cache due to event network-changed-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-15dd604c-a799-4ab2-a4e3-7e6d939abee7 req-fcd54c37-d394-4abd-863b-d3c2d6269a23 service nova] Acquiring lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-15dd604c-a799-4ab2-a4e3-7e6d939abee7 req-fcd54c37-d394-4abd-863b-d3c2d6269a23 service nova] Acquired lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG nova.network.neutron [req-15dd604c-a799-4ab2-a4e3-7e6d939abee7 req-fcd54c37-d394-4abd-863b-d3c2d6269a23 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Refreshing network info cache for port 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'flavor' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5e497004-a227-4b49-aad0-12561a47f213 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.817s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-15dd604c-a799-4ab2-a4e3-7e6d939abee7 req-fcd54c37-d394-4abd-863b-d3c2d6269a23 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updated VIF entry in instance network info cache for port 3f6a975d-16fc-4ff6-aa5a-f8255e577b7f. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-15dd604c-a799-4ab2-a4e3-7e6d939abee7 req-fcd54c37-d394-4abd-863b-d3c2d6269a23 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updating instance_info_cache with network_info: [{"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-15dd604c-a799-4ab2-a4e3-7e6d939abee7 req-fcd54c37-d394-4abd-863b-d3c2d6269a23 service nova] Releasing lock "refresh_cache-73fcc85e-48fd-486b-bda8-61d834d8cb42" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:23:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:23:45 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:23:45 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7663MB free_disk=25.193973541259766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Applying migration context for instance 53ee2aff-68a4-4015-82b3-30e842115c79 as it has an incoming, in-progress migration 086bd170-0ba5-4d3f-9552-ad399b899b9f. Migration status is finished {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 12:23:45 user nova-compute[73012]: INFO nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating resource usage from migration 086bd170-0ba5-4d3f-9552-ad399b899b9f
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 73fcc85e-48fd-486b-bda8-61d834d8cb42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 56391331-dd5f-4641-8208-72ba5cd514a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Migration 086bd170-0ba5-4d3f-9552-ad399b899b9f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 53ee2aff-68a4-4015-82b3-30e842115c79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e9be3988-9ba7-448b-b901-19e8aff1fe6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:23:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:23:46 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:23:46 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:23:46 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:23:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:23:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:47 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:23:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:23:47 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:47 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:50 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015815.2498062, 8e51a9ce-cd61-4c43-a297-7f313bf2a07c => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:23:50 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] VM Stopped (Lifecycle Event)
Aug 14 12:23:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-f8251f39-2e93-47c2-a54d-c9964bb58902 None None] [instance: 8e51a9ce-cd61-4c43-a297-7f313bf2a07c] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:23:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:23:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:23:59 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:23:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:23:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquired lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:23:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:23:59 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'info_cache' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updating instance_info_cache with network_info: [{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Releasing lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:24:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance destroyed successfully.
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'resources' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2032924741',display_name='tempest-AttachVolumeTestJSON-server-2032924741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2032924741',id=29,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI1LgcrTTw70xOoqnvcVDZtsOJhtmBHzQ19Oa/Uqxd3iuk4bkU5QYp2T1jIxwdRxvJI5QFQbqNJLL7XrstdskKAdhSkVcP7b1pJ7XBEdXgRVkMSdfZifb7EmSSsystmLA==',key_name='tempest-keypair-943368399',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-7htr0z6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=56391331-dd5f-4641-8208-72ba5cd514a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_vif [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde12db03-27, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:00 user nova-compute[73012]: INFO os_vif [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27')
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFXIWsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:24:00 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3598ff18-9a4a-488e-9b77-222ce958a751]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2675765e-12ce-4a4a-b535-bd67c06fbff0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:00 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:24:00 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:00 user nova-compute[73012]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:24:00 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad013c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b0934b-b518-452b-ab8e-57f4ffc6ee9f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4226199f-053b-49c7-b9ec-26908f0120b3]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5358ac3-3dc1-4bd5-b5b6-8c381e050ed9]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aadacb-6897-4642-a690-bebbfa53cddc]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9723f6-2305-4cb6-bd6a-8f4e15c1fe7d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c9d1e8-d161-47f2-8af3-67ed10b3d416]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260]
Aug 14 12:24:00 user nova-compute[73012]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260] successful.
Aug 14 12:24:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a80053c-46b3-44d2-b5b1-ee6226157710]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== disconnect_volume: return (294ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Start _get_guest_xml network_info=[{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFXIWsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '56391331-dd5f-4641-8208-72ba5cd514a4', 'attached_at': '', 'detached_at': '', 'volume_id': '1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a', 'serial': '1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a'}, 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '4b0aa558-aacc-4403-a182-ceee3d548222', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'numa_topology' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:00 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:24:00 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFXIWsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:24:00 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:24:00 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:24:00 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[597d61ff-c0e3-49d4-ac95-b8c893f4630e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:24:00 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[65015b34-3695-4256-a90a-ec5a3d579ce4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a] added
Aug 14 12:24:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b2f541-d9c4-4ae5-bca8-d24dc72bea7f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e8c64e-1180-4437-9192-1a47e0cfc28c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFXIWsSa {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFXIWsSa" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e0866b-2ca6-4e50-9842-fba2378b60ab]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EFXIWsSa'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1555c7c1-2f6f-4475-80a4-149e7f68baff]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c8ee73-e1c4-46db-9350-cbc36743b554]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:01 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:01 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:01 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:01 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a41583-d8ef-4a28-9b7c-8b07858a4a09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260]
Aug 14 12:24:01 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260] successful.
Aug 14 12:24:01 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff088c74-75a9-41bd-9f91-4881ef8c3863]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9038be8-32cf-48a7-9a4b-883af64ddc3c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:01 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:01 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:24:01 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:01 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:01 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:24:01 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b50d873-e3fc-45b4-9d95-f672b47831f5]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:24:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFXIWsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26665313839653833', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665313839653833', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2032924741',display_name='tempest-AttachVolumeTestJSON-server-2032924741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2032924741',id=29,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI1LgcrTTw70xOoqnvcVDZtsOJhtmBHzQ19Oa/Uqxd3iuk4bkU5QYp2T1jIxwdRxvJI5QFQbqNJLL7XrstdskKAdhSkVcP7b1pJ7XBEdXgRVkMSdfZifb7EmSSsystmLA==',key_name='tempest-keypair-943368399',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-7htr0z6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=56391331-dd5f-4641-8208-72ba5cd514a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'pci_devices' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:24:02 user nova-compute[73012]:   <uuid>56391331-dd5f-4641-8208-72ba5cd514a4</uuid>
Aug 14 12:24:02 user nova-compute[73012]:   <name>instance-0000001d</name>
Aug 14 12:24:02 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:24:02 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:24:02 user nova-compute[73012]:   <metadata>
Aug 14 12:24:02 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:24:02 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:24:02 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeTestJSON-server-2032924741</nova:name>
Aug 14 12:24:02 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:24:00</nova:creationTime>
Aug 14 12:24:02 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:24:02 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:24:02 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:24:02 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:24:02 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:24:02 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:24:02 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:24:02 user nova-compute[73012]:       <nova:owner>
Aug 14 12:24:02 user nova-compute[73012]:         <nova:user uuid="aa2eccd1b9c54304aa336bfb3361b782">tempest-AttachVolumeTestJSON-236615257-project-member</nova:user>
Aug 14 12:24:02 user nova-compute[73012]:         <nova:project uuid="cacdb90792d24af296884a7af3d8b1c6">tempest-AttachVolumeTestJSON-236615257</nova:project>
Aug 14 12:24:02 user nova-compute[73012]:       </nova:owner>
Aug 14 12:24:02 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:24:02 user nova-compute[73012]:       <nova:ports>
Aug 14 12:24:02 user nova-compute[73012]:         <nova:port uuid="de12db03-2755-471c-85d9-99fc6d4a0092">
Aug 14 12:24:02 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:24:02 user nova-compute[73012]:         </nova:port>
Aug 14 12:24:02 user nova-compute[73012]:       </nova:ports>
Aug 14 12:24:02 user nova-compute[73012]:     </nova:instance>
Aug 14 12:24:02 user nova-compute[73012]:   </metadata>
Aug 14 12:24:02 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:24:02 user nova-compute[73012]:     <system>
Aug 14 12:24:02 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:24:02 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:24:02 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:24:02 user nova-compute[73012]:       <entry name="serial">56391331-dd5f-4641-8208-72ba5cd514a4</entry>
Aug 14 12:24:02 user nova-compute[73012]:       <entry name="uuid">56391331-dd5f-4641-8208-72ba5cd514a4</entry>
Aug 14 12:24:02 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:24:02 user nova-compute[73012]:     </system>
Aug 14 12:24:02 user nova-compute[73012]:   </sysinfo>
Aug 14 12:24:02 user nova-compute[73012]:   <os>
Aug 14 12:24:02 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:24:02 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:24:02 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:24:02 user nova-compute[73012]:   </os>
Aug 14 12:24:02 user nova-compute[73012]:   <features>
Aug 14 12:24:02 user nova-compute[73012]:     <acpi/>
Aug 14 12:24:02 user nova-compute[73012]:     <apic/>
Aug 14 12:24:02 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:24:02 user nova-compute[73012]:   </features>
Aug 14 12:24:02 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:24:02 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:24:02 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:24:02 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:24:02 user nova-compute[73012]:   </clock>
Aug 14 12:24:02 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:24:02 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:24:02 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:24:02 user nova-compute[73012]:   </cpu>
Aug 14 12:24:02 user nova-compute[73012]:   <devices>
Aug 14 12:24:02 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:24:02 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:24:02 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk"/>
Aug 14 12:24:02 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:24:02 user nova-compute[73012]:     </disk>
Aug 14 12:24:02 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:24:02 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:24:02 user nova-compute[73012]:       <source dev="/dev/sdc"/>
Aug 14 12:24:02 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:24:02 user nova-compute[73012]:       <serial>1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a</serial>
Aug 14 12:24:02 user nova-compute[73012]:     </disk>
Aug 14 12:24:02 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:24:02 user nova-compute[73012]:       <mac address="fa:16:3e:08:4b:33"/>
Aug 14 12:24:02 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:24:02 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:24:02 user nova-compute[73012]:       <target dev="tapde12db03-27"/>
Aug 14 12:24:02 user nova-compute[73012]:     </interface>
Aug 14 12:24:02 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:24:02 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/console.log" append="off"/>
Aug 14 12:24:02 user nova-compute[73012]:     </serial>
Aug 14 12:24:02 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:24:02 user nova-compute[73012]:     <video>
Aug 14 12:24:02 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:24:02 user nova-compute[73012]:     </video>
Aug 14 12:24:02 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:24:02 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:24:02 user nova-compute[73012]:     </rng>
Aug 14 12:24:02 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:24:02 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:24:02 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:24:02 user nova-compute[73012]:     </memballoon>
Aug 14 12:24:02 user nova-compute[73012]:   </devices>
Aug 14 12:24:02 user nova-compute[73012]: </domain>
Aug 14 12:24:02 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'trusted_certs' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.215s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Cannot resize image /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'migration_context' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2032924741',display_name='tempest-AttachVolumeTestJSON-server-2032924741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2032924741',id=29,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI1LgcrTTw70xOoqnvcVDZtsOJhtmBHzQ19Oa/Uqxd3iuk4bkU5QYp2T1jIxwdRxvJI5QFQbqNJLL7XrstdskKAdhSkVcP7b1pJ7XBEdXgRVkMSdfZifb7EmSSsystmLA==',key_name='tempest-keypair-943368399',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-7htr0z6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=56391331-dd5f-4641-8208-72ba5cd514a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG os_vif [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde12db03-27, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde12db03-27, col_values=(('external_ids', {'iface-id': 'de12db03-2755-471c-85d9-99fc6d4a0092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:4b:33', 'vm-uuid': '56391331-dd5f-4641-8208-72ba5cd514a4'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:24:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:03 user nova-compute[73012]: INFO os_vif [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27')
Aug 14 12:24:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-8ae43278-5b5f-4036-96dd-58ee6d820c7c req-92268456-7e1e-4a2a-8b07-37486a6b367f service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:24:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8ae43278-5b5f-4036-96dd-58ee6d820c7c req-92268456-7e1e-4a2a-8b07-37486a6b367f service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8ae43278-5b5f-4036-96dd-58ee6d820c7c req-92268456-7e1e-4a2a-8b07-37486a6b367f service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8ae43278-5b5f-4036-96dd-58ee6d820c7c req-92268456-7e1e-4a2a-8b07-37486a6b367f service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-8ae43278-5b5f-4036-96dd-58ee6d820c7c req-92268456-7e1e-4a2a-8b07-37486a6b367f service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:24:05 user nova-compute[73012]: WARNING nova.compute.manager [req-8ae43278-5b5f-4036-96dd-58ee6d820c7c req-92268456-7e1e-4a2a-8b07-37486a6b367f service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state stopped and task_state powering-on.
Aug 14 12:24:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "913d1f19-4c67-45dd-92dd-a0a79418eda4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:24:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:24:06 user nova-compute[73012]: INFO nova.compute.claims [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Claim successful on node user
Aug 14 12:24:06 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015846.964861, 56391331-dd5f-4641-8208-72ba5cd514a4 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:24:06 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] VM Resumed (Lifecycle Event)
Aug 14 12:24:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:24:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance rebooted successfully.
Aug 14 12:24:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3b840dd6-2f38-4a43-895c-d43c4fd674f1 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:24:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:24:07 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015846.9675922, 56391331-dd5f-4641-8208-72ba5cd514a4 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:24:07 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] VM Started (Lifecycle Event)
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-22169fb6-30b1-4aa8-8b5d-32d6615da1ba req-e3568ebb-d712-4591-92da-2eff2a9cd36d service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22169fb6-30b1-4aa8-8b5d-32d6615da1ba req-e3568ebb-d712-4591-92da-2eff2a9cd36d service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22169fb6-30b1-4aa8-8b5d-32d6615da1ba req-e3568ebb-d712-4591-92da-2eff2a9cd36d service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-22169fb6-30b1-4aa8-8b5d-32d6615da1ba req-e3568ebb-d712-4591-92da-2eff2a9cd36d service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-22169fb6-30b1-4aa8-8b5d-32d6615da1ba req-e3568ebb-d712-4591-92da-2eff2a9cd36d service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:24:07 user nova-compute[73012]: WARNING nova.compute.manager [req-22169fb6-30b1-4aa8-8b5d-32d6615da1ba req-e3568ebb-d712-4591-92da-2eff2a9cd36d service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state active and task_state None.
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.network.neutron [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:24:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:24:07 user nova-compute[73012]: DEBUG nova.policy [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0311f0fd37f143739604c409233537fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7699b5c3fcc34a619e5d0d066e8ff642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:24:07 user nova-compute[73012]: INFO nova.virt.block_device [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Booting with volume snapshot 288c2ca8-a132-4616-be5b-3c0f0dc5f9fa at /dev/vda
Aug 14 12:24:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Successfully created port: c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:24:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Successfully updated port: c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:24:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "refresh_cache-913d1f19-4c67-45dd-92dd-a0a79418eda4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:24:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquired lock "refresh_cache-913d1f19-4c67-45dd-92dd-a0a79418eda4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:24:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:24:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-ac7d8a72-9fbc-4e85-af57-fba29d957d77 req-c5fbcea9-48ae-475c-af76-1ff456183e75 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received event network-changed-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:24:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-ac7d8a72-9fbc-4e85-af57-fba29d957d77 req-c5fbcea9-48ae-475c-af76-1ff456183e75 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Refreshing instance network info cache due to event network-changed-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:24:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ac7d8a72-9fbc-4e85-af57-fba29d957d77 req-c5fbcea9-48ae-475c-af76-1ff456183e75 service nova] Acquiring lock "refresh_cache-913d1f19-4c67-45dd-92dd-a0a79418eda4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:24:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:24:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Updating instance_info_cache with network_info: [{"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:24:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Releasing lock "refresh_cache-913d1f19-4c67-45dd-92dd-a0a79418eda4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:24:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Instance network_info: |[{"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:24:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ac7d8a72-9fbc-4e85-af57-fba29d957d77 req-c5fbcea9-48ae-475c-af76-1ff456183e75 service nova] Acquired lock "refresh_cache-913d1f19-4c67-45dd-92dd-a0a79418eda4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:24:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-ac7d8a72-9fbc-4e85-af57-fba29d957d77 req-c5fbcea9-48ae-475c-af76-1ff456183e75 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Refreshing network info cache for port c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:24:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-ac7d8a72-9fbc-4e85-af57-fba29d957d77 req-c5fbcea9-48ae-475c-af76-1ff456183e75 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Updated VIF entry in instance network info cache for port c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:24:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-ac7d8a72-9fbc-4e85-af57-fba29d957d77 req-c5fbcea9-48ae-475c-af76-1ff456183e75 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Updating instance_info_cache with network_info: [{"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:24:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ac7d8a72-9fbc-4e85-af57-fba29d957d77 req-c5fbcea9-48ae-475c-af76-1ff456183e75 service nova] Releasing lock "refresh_cache-913d1f19-4c67-45dd-92dd-a0a79418eda4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:24:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG os_brick.utils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2fb338-9186-47b3-906b-ef7cb0cebe32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20f04fc-fcdc-49bc-ba4a-8ea99a1a97d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1d8fbe-f369-45e3-9713-1c07012fadb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e6fa7-c221-4c6e-8d83-3b24e7cbd525]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:24:13 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d850b5d-709a-48e5-99aa-3ece0dbae8b4]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG os_brick.utils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Updating existing volume attachment record: 809c0543-a3c5-4836-a945-fb0d94773069 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Going to confirm migration 1 {{(pid=73012) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquired lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG nova.network.neutron [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:24:13 user nova-compute[73012]: DEBUG nova.objects.instance [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'info_cache' on Instance uuid 53ee2aff-68a4-4015-82b3-30e842115c79 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:14 user nova-compute[73012]: DEBUG nova.network.neutron [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating instance_info_cache with network_info: [{"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:24:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Releasing lock "refresh_cache-53ee2aff-68a4-4015-82b3-30e842115c79" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:24:14 user nova-compute[73012]: DEBUG nova.objects.instance [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'migration_context' on Instance uuid 53ee2aff-68a4-4015-82b3-30e842115c79 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:14 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:24:14 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:24:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.436s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:15 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Deleted allocation for migration 086bd170-0ba5-4d3f-9552-ad399b899b9f
Aug 14 12:24:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-58fe123b-3980-4053-8874-3cce83a4773f tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.503s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:24:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:24:22 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Creating image(s)
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Ensure instance console log exists: /opt/stack/data/nova/instances/913d1f19-4c67-45dd-92dd-a0a79418eda4/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Start _get_guest_xml network_info=[{"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdZqXvhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '913d1f19-4c67-45dd-92dd-a0a79418eda4', 'attached_at': '', 'detached_at': '', 'volume_id': '9a4a308b-7ba1-42b4-bc53-20424ca6ba5b', 'serial': '9a4a308b-7ba1-42b4-bc53-20424ca6ba5b'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '809c0543-a3c5-4836-a945-fb0d94773069', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:24:22 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:24:22 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdZqXvhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:24:22 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:24:22 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:24:22 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a3c4cb-c863-4c2d-989c-68a9223ead76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:24:22 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7794289-8b01-4920-b458-1c1ff7722e57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b] added
Aug 14 12:24:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01ea7f2-1e02-4616-9ad3-46a33eedca2d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcfbdf3-449f-4f55-b478-833b21c29f5c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdZqXvhw {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HdZqXvhw" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc88f9-6663-4131-84a6-a237febb3d68]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HdZqXvhw'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9375e3ec-d62f-46d3-896f-27a115b99706]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab454a0-c063-45d7-bd09-d380a19ded90]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:24:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:24:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f7ff41-1c5d-42f9-9aa6-23e522439bc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b, portal: 172.16.0.220,3260]
Aug 14 12:24:22 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b, portal: 172.16.0.220,3260] successful.
Aug 14 12:24:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2903e4-3ad9-4983-86ee-33060a6c0f05]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34ba85a-f23d-40d2-9a5f-9b5cafba5de5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:24:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:24:22 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:24:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18a84d2-ec0d-4101-84e5-f1460e7460eb]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdZqXvhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26433303264653639', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433303264653639', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:24:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-535063527',display_name='tempest-TestVolumeBootPattern-server-535063527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-535063527',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-d87qfbct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:24:08Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=913d1f19-4c67-45dd-92dd-a0a79418eda4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:0f:db,bridge_name='br-int',has_traffic_filtering=True,id=c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3081c14-9f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.objects.instance [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'pci_devices' on Instance uuid 913d1f19-4c67-45dd-92dd-a0a79418eda4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:24:23 user nova-compute[73012]:   <uuid>913d1f19-4c67-45dd-92dd-a0a79418eda4</uuid>
Aug 14 12:24:23 user nova-compute[73012]:   <name>instance-00000021</name>
Aug 14 12:24:23 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:24:23 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:24:23 user nova-compute[73012]:   <metadata>
Aug 14 12:24:23 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:24:23 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:24:23 user nova-compute[73012]:       <nova:name>tempest-TestVolumeBootPattern-server-535063527</nova:name>
Aug 14 12:24:23 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:24:22</nova:creationTime>
Aug 14 12:24:23 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:24:23 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:24:23 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:24:23 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:24:23 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:24:23 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:24:23 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:24:23 user nova-compute[73012]:       <nova:owner>
Aug 14 12:24:23 user nova-compute[73012]:         <nova:user uuid="0311f0fd37f143739604c409233537fa">tempest-TestVolumeBootPattern-1572075418-project-member</nova:user>
Aug 14 12:24:23 user nova-compute[73012]:         <nova:project uuid="7699b5c3fcc34a619e5d0d066e8ff642">tempest-TestVolumeBootPattern-1572075418</nova:project>
Aug 14 12:24:23 user nova-compute[73012]:       </nova:owner>
Aug 14 12:24:23 user nova-compute[73012]:       <nova:ports>
Aug 14 12:24:23 user nova-compute[73012]:         <nova:port uuid="c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf">
Aug 14 12:24:23 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 12:24:23 user nova-compute[73012]:         </nova:port>
Aug 14 12:24:23 user nova-compute[73012]:       </nova:ports>
Aug 14 12:24:23 user nova-compute[73012]:     </nova:instance>
Aug 14 12:24:23 user nova-compute[73012]:   </metadata>
Aug 14 12:24:23 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:24:23 user nova-compute[73012]:     <system>
Aug 14 12:24:23 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:24:23 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:24:23 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:24:23 user nova-compute[73012]:       <entry name="serial">913d1f19-4c67-45dd-92dd-a0a79418eda4</entry>
Aug 14 12:24:23 user nova-compute[73012]:       <entry name="uuid">913d1f19-4c67-45dd-92dd-a0a79418eda4</entry>
Aug 14 12:24:23 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:24:23 user nova-compute[73012]:     </system>
Aug 14 12:24:23 user nova-compute[73012]:   </sysinfo>
Aug 14 12:24:23 user nova-compute[73012]:   <os>
Aug 14 12:24:23 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:24:23 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:24:23 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:24:23 user nova-compute[73012]:   </os>
Aug 14 12:24:23 user nova-compute[73012]:   <features>
Aug 14 12:24:23 user nova-compute[73012]:     <acpi/>
Aug 14 12:24:23 user nova-compute[73012]:     <apic/>
Aug 14 12:24:23 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:24:23 user nova-compute[73012]:   </features>
Aug 14 12:24:23 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:24:23 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:24:23 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:24:23 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:24:23 user nova-compute[73012]:   </clock>
Aug 14 12:24:23 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:24:23 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:24:23 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:24:23 user nova-compute[73012]:   </cpu>
Aug 14 12:24:23 user nova-compute[73012]:   <devices>
Aug 14 12:24:23 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:24:23 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:24:23 user nova-compute[73012]:       <source dev="/dev/sdd"/>
Aug 14 12:24:23 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:24:23 user nova-compute[73012]:       <serial>9a4a308b-7ba1-42b4-bc53-20424ca6ba5b</serial>
Aug 14 12:24:23 user nova-compute[73012]:     </disk>
Aug 14 12:24:23 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:24:23 user nova-compute[73012]:       <mac address="fa:16:3e:f8:0f:db"/>
Aug 14 12:24:23 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:24:23 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:24:23 user nova-compute[73012]:       <target dev="tapc3081c14-9f"/>
Aug 14 12:24:23 user nova-compute[73012]:     </interface>
Aug 14 12:24:23 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:24:23 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/913d1f19-4c67-45dd-92dd-a0a79418eda4/console.log" append="off"/>
Aug 14 12:24:23 user nova-compute[73012]:     </serial>
Aug 14 12:24:23 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:24:23 user nova-compute[73012]:     <video>
Aug 14 12:24:23 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:24:23 user nova-compute[73012]:     </video>
Aug 14 12:24:23 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:24:23 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:24:23 user nova-compute[73012]:     </rng>
Aug 14 12:24:23 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:24:23 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:24:23 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:24:23 user nova-compute[73012]:     </memballoon>
Aug 14 12:24:23 user nova-compute[73012]:   </devices>
Aug 14 12:24:23 user nova-compute[73012]: </domain>
Aug 14 12:24:23 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:24:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-535063527',display_name='tempest-TestVolumeBootPattern-server-535063527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-535063527',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-d87qfbct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:24:08Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=913d1f19-4c67-45dd-92dd-a0a79418eda4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:0f:db,bridge_name='br-int',has_traffic_filtering=True,id=c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3081c14-9f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG os_vif [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:0f:db,bridge_name='br-int',has_traffic_filtering=True,id=c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3081c14-9f') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3081c14-9f, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3081c14-9f, col_values=(('external_ids', {'iface-id': 'c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:0f:db', 'vm-uuid': '913d1f19-4c67-45dd-92dd-a0a79418eda4'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:23 user nova-compute[73012]: INFO os_vif [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:0f:db,bridge_name='br-int',has_traffic_filtering=True,id=c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3081c14-9f')
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:24:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No VIF found with MAC fa:16:3e:f8:0f:db, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:24:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-38c4c7cc-863d-454e-9114-3a4fe1ce2603 req-117d147c-ec66-4325-99b4-129ecbad39e0 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received event network-vif-plugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-38c4c7cc-863d-454e-9114-3a4fe1ce2603 req-117d147c-ec66-4325-99b4-129ecbad39e0 service nova] Acquiring lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-38c4c7cc-863d-454e-9114-3a4fe1ce2603 req-117d147c-ec66-4325-99b4-129ecbad39e0 service nova] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-38c4c7cc-863d-454e-9114-3a4fe1ce2603 req-117d147c-ec66-4325-99b4-129ecbad39e0 service nova] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-38c4c7cc-863d-454e-9114-3a4fe1ce2603 req-117d147c-ec66-4325-99b4-129ecbad39e0 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] No waiting events found dispatching network-vif-plugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:24:25 user nova-compute[73012]: WARNING nova.compute.manager [req-38c4c7cc-863d-454e-9114-3a4fe1ce2603 req-117d147c-ec66-4325-99b4-129ecbad39e0 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received unexpected event network-vif-plugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf for instance with vm_state building and task_state spawning.
Aug 14 12:24:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015867.3069277, 913d1f19-4c67-45dd-92dd-a0a79418eda4 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:24:27 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] VM Resumed (Lifecycle Event)
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:24:27 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Instance spawned successfully.
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:24:27 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015867.308495, 913d1f19-4c67-45dd-92dd-a0a79418eda4 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:24:27 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] VM Started (Lifecycle Event)
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-8d9b9d1e-aef3-4bf1-80b9-98fbd5c4a9e5 req-a29cc29b-0d05-4dbc-ade4-fe2deb5822d5 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received event network-vif-plugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8d9b9d1e-aef3-4bf1-80b9-98fbd5c4a9e5 req-a29cc29b-0d05-4dbc-ade4-fe2deb5822d5 service nova] Acquiring lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8d9b9d1e-aef3-4bf1-80b9-98fbd5c4a9e5 req-a29cc29b-0d05-4dbc-ade4-fe2deb5822d5 service nova] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8d9b9d1e-aef3-4bf1-80b9-98fbd5c4a9e5 req-a29cc29b-0d05-4dbc-ade4-fe2deb5822d5 service nova] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-8d9b9d1e-aef3-4bf1-80b9-98fbd5c4a9e5 req-a29cc29b-0d05-4dbc-ade4-fe2deb5822d5 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] No waiting events found dispatching network-vif-plugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:24:27 user nova-compute[73012]: WARNING nova.compute.manager [req-8d9b9d1e-aef3-4bf1-80b9-98fbd5c4a9e5 req-a29cc29b-0d05-4dbc-ade4-fe2deb5822d5 service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received unexpected event network-vif-plugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf for instance with vm_state building and task_state spawning.
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:24:27 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:24:27 user nova-compute[73012]: INFO nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Took 5.22 seconds to spawn the instance on the hypervisor.
Aug 14 12:24:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:24:27 user nova-compute[73012]: INFO nova.compute.manager [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Took 20.64 seconds to build instance.
Aug 14 12:24:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-60f396ee-ed16-4737-a77e-5ba152418999 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.744s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:32 user nova-compute[73012]: INFO nova.compute.manager [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Terminating instance
Aug 14 12:24:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-237a83b0-b612-4146-9786-304989997a7b req-33539f9f-5711-4203-be4d-5c5c376ad8af service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-237a83b0-b612-4146-9786-304989997a7b req-33539f9f-5711-4203-be4d-5c5c376ad8af service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-237a83b0-b612-4146-9786-304989997a7b req-33539f9f-5711-4203-be4d-5c5c376ad8af service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-237a83b0-b612-4146-9786-304989997a7b req-33539f9f-5711-4203-be4d-5c5c376ad8af service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-237a83b0-b612-4146-9786-304989997a7b req-33539f9f-5711-4203-be4d-5c5c376ad8af service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-237a83b0-b612-4146-9786-304989997a7b req-33539f9f-5711-4203-be4d-5c5c376ad8af service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-unplugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Instance destroyed successfully.
Aug 14 12:24:33 user nova-compute[73012]: DEBUG nova.objects.instance [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'resources' on Instance uuid 73fcc85e-48fd-486b-bda8-61d834d8cb42 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1359014402',display_name='tempest-ServerRescueNegativeTestJSON-server-1359014402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1359014402',id=28,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCokD7dXCKAM145fVpuWRhcuXCdxQNaK+YpOqywGLUbdT2cmO+aiYIjn4YEGVfFxlYEUhlqQSZ8T5sIoNQgJF2f1ynoY+lLYv/aWuCkYd7uVSy6jO7Hs3fUaQ0OKHNtz5Q==',key_name='tempest-keypair-737251042',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-fjrz43xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7128922092841c49b475af30075e458',uuid=73fcc85e-48fd-486b-bda8-61d834d8cb42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "address": "fa:16:3e:6a:de:c7", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6a975d-16", "ovs_interfaceid": "3f6a975d-16fc-4ff6-aa5a-f8255e577b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:de:c7,bridge_name='br-int',has_traffic_filtering=True,id=3f6a975d-16fc-4ff6-aa5a-f8255e577b7f,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6a975d-16') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG os_vif [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:de:c7,bridge_name='br-int',has_traffic_filtering=True,id=3f6a975d-16fc-4ff6-aa5a-f8255e577b7f,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6a975d-16') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f6a975d-16, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:24:33 user nova-compute[73012]: INFO os_vif [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:de:c7,bridge_name='br-int',has_traffic_filtering=True,id=3f6a975d-16fc-4ff6-aa5a-f8255e577b7f,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6a975d-16')
Aug 14 12:24:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Deleting instance files /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42_del
Aug 14 12:24:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Deletion of /opt/stack/data/nova/instances/73fcc85e-48fd-486b-bda8-61d834d8cb42_del complete
Aug 14 12:24:33 user nova-compute[73012]: INFO nova.compute.manager [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 14 12:24:33 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:24:33 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:24:34 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:24:34 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Took 0.96 seconds to deallocate network for instance.
Aug 14 12:24:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:34 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:24:34 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:24:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:34 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Deleted allocations for instance 73fcc85e-48fd-486b-bda8-61d834d8cb42
Aug 14 12:24:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-d2a16774-df76-4cc4-bc64-58ce38b61e71 req-e1ed1f24-7e1b-44f6-bf7e-53fb196fb5e2 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:24:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d2a16774-df76-4cc4-bc64-58ce38b61e71 req-e1ed1f24-7e1b-44f6-bf7e-53fb196fb5e2 service nova] Acquiring lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d2a16774-df76-4cc4-bc64-58ce38b61e71 req-e1ed1f24-7e1b-44f6-bf7e-53fb196fb5e2 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d2a16774-df76-4cc4-bc64-58ce38b61e71 req-e1ed1f24-7e1b-44f6-bf7e-53fb196fb5e2 service nova] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-d2a16774-df76-4cc4-bc64-58ce38b61e71 req-e1ed1f24-7e1b-44f6-bf7e-53fb196fb5e2 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] No waiting events found dispatching network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:24:34 user nova-compute[73012]: WARNING nova.compute.manager [req-d2a16774-df76-4cc4-bc64-58ce38b61e71 req-e1ed1f24-7e1b-44f6-bf7e-53fb196fb5e2 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received unexpected event network-vif-plugged-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f for instance with vm_state deleted and task_state None.
Aug 14 12:24:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-d2a16774-df76-4cc4-bc64-58ce38b61e71 req-e1ed1f24-7e1b-44f6-bf7e-53fb196fb5e2 service nova] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Received event network-vif-deleted-3f6a975d-16fc-4ff6-aa5a-f8255e577b7f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:24:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-da5ed9ae-7365-4f72-a591-1ecd1657bde1 tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "73fcc85e-48fd-486b-bda8-61d834d8cb42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.459s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:24:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:24:41 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:24:41 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:24:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:41 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:24:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:24:43 user nova-compute[73012]: INFO nova.compute.claims [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Claim successful on node user
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:24:43 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:44 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:24:44 user nova-compute[73012]: INFO nova.virt.block_device [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Booting with volume-backed-image f1c1bbe4-a191-4a75-9890-606d22f47ada at /dev/vda
Aug 14 12:24:44 user nova-compute[73012]: DEBUG nova.policy [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae1ce3345617447486642ebe88c1621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1960abc96445f483386773f67d83e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.network.neutron [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Successfully created port: 2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:24:45 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:24:45 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7563MB free_disk=25.21575927734375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 56391331-dd5f-4641-8208-72ba5cd514a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 53ee2aff-68a4-4015-82b3-30e842115c79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e9be3988-9ba7-448b-b901-19e8aff1fe6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 913d1f19-4c67-45dd-92dd-a0a79418eda4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance f71ae265-b116-4048-8549-3bf44c6cdc9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:24:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.network.neutron [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Successfully updated port: 2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquired lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.network.neutron [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.compute.manager [req-96052d13-8b63-45f6-9ffa-57d89ed6e9a1 req-24fea79a-8d65-4a35-8fdc-80a7012e6a50 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-changed-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.compute.manager [req-96052d13-8b63-45f6-9ffa-57d89ed6e9a1 req-24fea79a-8d65-4a35-8fdc-80a7012e6a50 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Refreshing instance network info cache due to event network-changed-2249834b-3b89-4d69-a520-ac8b00707c36. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-96052d13-8b63-45f6-9ffa-57d89ed6e9a1 req-24fea79a-8d65-4a35-8fdc-80a7012e6a50 service nova] Acquiring lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.network.neutron [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.network.neutron [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Updating instance_info_cache with network_info: [{"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Releasing lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Instance network_info: |[{"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-96052d13-8b63-45f6-9ffa-57d89ed6e9a1 req-24fea79a-8d65-4a35-8fdc-80a7012e6a50 service nova] Acquired lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.network.neutron [req-96052d13-8b63-45f6-9ffa-57d89ed6e9a1 req-24fea79a-8d65-4a35-8fdc-80a7012e6a50 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Refreshing network info cache for port 2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.network.neutron [req-96052d13-8b63-45f6-9ffa-57d89ed6e9a1 req-24fea79a-8d65-4a35-8fdc-80a7012e6a50 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Updated VIF entry in instance network info cache for port 2249834b-3b89-4d69-a520-ac8b00707c36. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG nova.network.neutron [req-96052d13-8b63-45f6-9ffa-57d89ed6e9a1 req-24fea79a-8d65-4a35-8fdc-80a7012e6a50 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Updating instance_info_cache with network_info: [{"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:24:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-96052d13-8b63-45f6-9ffa-57d89ed6e9a1 req-24fea79a-8d65-4a35-8fdc-80a7012e6a50 service nova] Releasing lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:24:47 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:24:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:24:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:24:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Skipping network cache update for instance because it is Building. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 66fb72b1-30a9-4be2-b843-7d648fc66e16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015873.3884861, 73fcc85e-48fd-486b-bda8-61d834d8cb42 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:24:48 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] VM Stopped (Lifecycle Event)
Aug 14 12:24:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b7ae4e47-64f5-4f86-af42-cff67470f2df None None] [instance: 73fcc85e-48fd-486b-bda8-61d834d8cb42] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updating instance_info_cache with network_info: [{"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-66fb72b1-30a9-4be2-b843-7d648fc66e16" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:24:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:24:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG os_brick.utils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[136fb1b6-b71f-468e-acb4-93139ff9217b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc8c7c8-ba47-4384-a8c5-0f5d62363324]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1dd930-95d3-417e-a403-d5965ef0299e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bda3c3-90a6-44ee-972d-7600aac7dcf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:24:55 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:24:55 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d364a191-6899-4909-97a2-6c7a9160620a]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG os_brick.utils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Updating existing volume attachment record: bf0ddea5-f055-4774-9507-ef7b65baba56 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:24:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:24:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:25:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Creating image(s)
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Ensure instance console log exists: /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Start _get_guest_xml network_info=[{"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNjxgpLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f71ae265-b116-4048-8549-3bf44c6cdc9b', 'attached_at': '', 'detached_at': '', 'volume_id': '7843bf23-ee40-45fe-a3d1-f1ea0450de84', 'serial': '7843bf23-ee40-45fe-a3d1-f1ea0450de84'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'bf0ddea5-f055-4774-9507-ef7b65baba56', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:25:03 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:25:03 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNjxgpLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:25:03 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:25:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:25:03 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:25:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:25:03 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2ca1aa-e468-4104-90ec-094fa84be3b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:25:03 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ecef9e-69b1-458a-8ec5-9297a565efa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84] added
Aug 14 12:25:03 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d01efa-d4be-4386-adca-43de660ae260]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d276be-7a5e-4080-b57e-1e3556c36d60]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNjxgpLd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNjxgpLd" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd66e6-3d48-4d00-832b-7760b3565f83]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNjxgpLd'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3301ca-2c89-4259-9ade-b19a3e9ef877]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dcaeee-4fa5-4864-abea-ef492a105b1c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b10bc1f-097d-4034-bd66-03ab32094287]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84, portal: 172.16.0.220,3260]
Aug 14 12:25:04 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84, portal: 172.16.0.220,3260] successful.
Aug 14 12:25:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f954c22-94b5-4536-925d-20b76d725648]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e768b3-9e63-4316-93aa-30ddc5afa820]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:04 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[89940c07-8bb2-4178-9313-147d0c775684]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:25:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNjxgpLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26663666230373961', 'path': '/dev/sdf'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663666230373961', 'path': '/dev/sdf'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1013196602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1013196602',id=34,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-mla0txnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:24:44Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=f71ae265-b116-4048-8549-3bf44c6cdc9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=2249834b-3b89-4d69-a520-ac8b00707c36,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2249834b-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.objects.instance [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'pci_devices' on Instance uuid f71ae265-b116-4048-8549-3bf44c6cdc9b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:25:05 user nova-compute[73012]:   <uuid>f71ae265-b116-4048-8549-3bf44c6cdc9b</uuid>
Aug 14 12:25:05 user nova-compute[73012]:   <name>instance-00000022</name>
Aug 14 12:25:05 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:25:05 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:25:05 user nova-compute[73012]:   <metadata>
Aug 14 12:25:05 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:25:05 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:25:05 user nova-compute[73012]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1013196602</nova:name>
Aug 14 12:25:05 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:25:03</nova:creationTime>
Aug 14 12:25:05 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:25:05 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:25:05 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:25:05 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:25:05 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:25:05 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:25:05 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:25:05 user nova-compute[73012]:       <nova:owner>
Aug 14 12:25:05 user nova-compute[73012]:         <nova:user uuid="ae1ce3345617447486642ebe88c1621c">tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member</nova:user>
Aug 14 12:25:05 user nova-compute[73012]:         <nova:project uuid="6b1960abc96445f483386773f67d83e3">tempest-ServerBootFromVolumeStableRescueTest-1756944789</nova:project>
Aug 14 12:25:05 user nova-compute[73012]:       </nova:owner>
Aug 14 12:25:05 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:25:05 user nova-compute[73012]:       <nova:ports>
Aug 14 12:25:05 user nova-compute[73012]:         <nova:port uuid="2249834b-3b89-4d69-a520-ac8b00707c36">
Aug 14 12:25:05 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 12:25:05 user nova-compute[73012]:         </nova:port>
Aug 14 12:25:05 user nova-compute[73012]:       </nova:ports>
Aug 14 12:25:05 user nova-compute[73012]:     </nova:instance>
Aug 14 12:25:05 user nova-compute[73012]:   </metadata>
Aug 14 12:25:05 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:25:05 user nova-compute[73012]:     <system>
Aug 14 12:25:05 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:25:05 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:25:05 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:25:05 user nova-compute[73012]:       <entry name="serial">f71ae265-b116-4048-8549-3bf44c6cdc9b</entry>
Aug 14 12:25:05 user nova-compute[73012]:       <entry name="uuid">f71ae265-b116-4048-8549-3bf44c6cdc9b</entry>
Aug 14 12:25:05 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:25:05 user nova-compute[73012]:     </system>
Aug 14 12:25:05 user nova-compute[73012]:   </sysinfo>
Aug 14 12:25:05 user nova-compute[73012]:   <os>
Aug 14 12:25:05 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:25:05 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:25:05 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:25:05 user nova-compute[73012]:   </os>
Aug 14 12:25:05 user nova-compute[73012]:   <features>
Aug 14 12:25:05 user nova-compute[73012]:     <acpi/>
Aug 14 12:25:05 user nova-compute[73012]:     <apic/>
Aug 14 12:25:05 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:25:05 user nova-compute[73012]:   </features>
Aug 14 12:25:05 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:25:05 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:25:05 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:25:05 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:25:05 user nova-compute[73012]:   </clock>
Aug 14 12:25:05 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:25:05 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:25:05 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:25:05 user nova-compute[73012]:   </cpu>
Aug 14 12:25:05 user nova-compute[73012]:   <devices>
Aug 14 12:25:05 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:25:05 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:25:05 user nova-compute[73012]:       <source dev="/dev/sdf"/>
Aug 14 12:25:05 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:25:05 user nova-compute[73012]:       <serial>7843bf23-ee40-45fe-a3d1-f1ea0450de84</serial>
Aug 14 12:25:05 user nova-compute[73012]:     </disk>
Aug 14 12:25:05 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:25:05 user nova-compute[73012]:       <mac address="fa:16:3e:e6:63:5d"/>
Aug 14 12:25:05 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:25:05 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:25:05 user nova-compute[73012]:       <target dev="tap2249834b-3b"/>
Aug 14 12:25:05 user nova-compute[73012]:     </interface>
Aug 14 12:25:05 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:25:05 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/console.log" append="off"/>
Aug 14 12:25:05 user nova-compute[73012]:     </serial>
Aug 14 12:25:05 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:25:05 user nova-compute[73012]:     <video>
Aug 14 12:25:05 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:25:05 user nova-compute[73012]:     </video>
Aug 14 12:25:05 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:25:05 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:25:05 user nova-compute[73012]:     </rng>
Aug 14 12:25:05 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:25:05 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:25:05 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:25:05 user nova-compute[73012]:     </memballoon>
Aug 14 12:25:05 user nova-compute[73012]:   </devices>
Aug 14 12:25:05 user nova-compute[73012]: </domain>
Aug 14 12:25:05 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1013196602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1013196602',id=34,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-mla0txnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:24:44Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=f71ae265-b116-4048-8549-3bf44c6cdc9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=2249834b-3b89-4d69-a520-ac8b00707c36,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2249834b-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG os_vif [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=2249834b-3b89-4d69-a520-ac8b00707c36,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2249834b-3b') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2249834b-3b, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2249834b-3b, col_values=(('external_ids', {'iface-id': '2249834b-3b89-4d69-a520-ac8b00707c36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:63:5d', 'vm-uuid': 'f71ae265-b116-4048-8549-3bf44c6cdc9b'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:05 user nova-compute[73012]: INFO os_vif [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=2249834b-3b89-4d69-a520-ac8b00707c36,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2249834b-3b')
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:25:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No VIF found with MAC fa:16:3e:e6:63:5d, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-b86ff66d-1b79-4bd0-a638-9397e1bde305 req-19f7ca3a-6206-49fd-97e4-3411b9934ac3 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b86ff66d-1b79-4bd0-a638-9397e1bde305 req-19f7ca3a-6206-49fd-97e4-3411b9934ac3 service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b86ff66d-1b79-4bd0-a638-9397e1bde305 req-19f7ca3a-6206-49fd-97e4-3411b9934ac3 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b86ff66d-1b79-4bd0-a638-9397e1bde305 req-19f7ca3a-6206-49fd-97e4-3411b9934ac3 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-b86ff66d-1b79-4bd0-a638-9397e1bde305 req-19f7ca3a-6206-49fd-97e4-3411b9934ac3 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:06 user nova-compute[73012]: WARNING nova.compute.manager [req-b86ff66d-1b79-4bd0-a638-9397e1bde305 req-19f7ca3a-6206-49fd-97e4-3411b9934ac3 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state building and task_state spawning.
Aug 14 12:25:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015908.733687, f71ae265-b116-4048-8549-3bf44c6cdc9b => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:25:08 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] VM Resumed (Lifecycle Event)
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:25:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Instance spawned successfully.
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:25:08 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015908.7370596, f71ae265-b116-4048-8549-3bf44c6cdc9b => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:25:08 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] VM Started (Lifecycle Event)
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:25:08 user nova-compute[73012]: INFO nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:08 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:25:08 user nova-compute[73012]: INFO nova.compute.manager [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Took 25.49 seconds to build instance.
Aug 14 12:25:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-137b7de4-ee07-4e49-af8d-95df84733f74 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.603s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-c905ea20-8b05-4a82-92df-b4f903897ab5 req-c3874773-b56a-4f7d-8d70-3b48f7555a42 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c905ea20-8b05-4a82-92df-b4f903897ab5 req-c3874773-b56a-4f7d-8d70-3b48f7555a42 service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c905ea20-8b05-4a82-92df-b4f903897ab5 req-c3874773-b56a-4f7d-8d70-3b48f7555a42 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c905ea20-8b05-4a82-92df-b4f903897ab5 req-c3874773-b56a-4f7d-8d70-3b48f7555a42 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-c905ea20-8b05-4a82-92df-b4f903897ab5 req-c3874773-b56a-4f7d-8d70-3b48f7555a42 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:09 user nova-compute[73012]: WARNING nova.compute.manager [req-c905ea20-8b05-4a82-92df-b4f903897ab5 req-c3874773-b56a-4f7d-8d70-3b48f7555a42 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state active and task_state None.
Aug 14 12:25:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'flavor' on Instance uuid e9be3988-9ba7-448b-b901-19e8aff1fe6a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:12 user nova-compute[73012]: INFO nova.compute.manager [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Attaching volume df46d282-746d-4193-8e75-9e08d6f58020 to /dev/vdb
Aug 14 12:25:12 user nova-compute[73012]: DEBUG os_brick.utils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f205c721-b444-4ee4-b76f-40ba7e11a827]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a67b8-b1e8-4951-95fd-dd502a1d807a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea413a6-be10-4eda-8050-a3028fce60ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f90e34-790d-40d2-908c-32587cf46da7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:25:12 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:25:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[83871d17-c731-4a26-b052-8e3da8e36fac]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG os_brick.utils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:25:12 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updating existing volume attachment record: 9ba90583-8f16-4167-a39d-1160f0b0fc88 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:25:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:25:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:25:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:25:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:25:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpfRblKH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:25:22 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:25:22 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:25:22 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cfdd5d-37ee-48e2-b116-67663626efe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:25:22 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a84c89-13b9-46a8-a1b5-8999cb224f75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020] added
Aug 14 12:25:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[04adfdb7-fc64-45c8-af17-0947feb17d7f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[318460ab-ca0f-42bc-91ab-7b3d14efbba6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpfRblKH {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpfRblKH" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e770ff63-00f7-41f9-b903-93cf6d11c178]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OpfRblKH'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5daeaa1-6b9e-420f-af43-e4b673bb2a20]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaa0d1f-d004-4f2f-adf0-a028b1cc93d6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc40c93-dc02-4093-addc-ae65f4aa863e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020, portal: 172.16.0.220,3260]
Aug 14 12:25:22 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020, portal: 172.16.0.220,3260] successful.
Aug 14 12:25:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adc07ba-ec39-4078-8071-fb42b683273e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60c7440-8601-42e0-ac06-738cc703c895]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:25:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c22721-9158-4dfd-b0c3-f72d148770f2]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:25:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpfRblKH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:25:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:25:23 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23564366236363032', 'path': '/dev/sdg'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:25:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564366236363032', 'path': '/dev/sdg'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:25:23 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'flavor' on Instance uuid e9be3988-9ba7-448b-b901-19e8aff1fe6a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:25:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:25:23 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:25:23 user nova-compute[73012]:   <source dev="/dev/sdg"/>
Aug 14 12:25:23 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:25:23 user nova-compute[73012]:   <serial>df46d282-746d-4193-8e75-9e08d6f58020</serial>
Aug 14 12:25:23 user nova-compute[73012]: </disk>
Aug 14 12:25:23 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:25:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:25:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:25:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] No VIF found with MAC fa:16:3e:45:53:2f, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:25:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6bf79d73-7a01-4b8c-8742-8df224721e88 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.756s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:25:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:25:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:25:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:25:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:25:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-1d7b492f-338a-4c9f-bda7-3d3339bf64aa req-3217e20d-dab9-403b-94de-b68aaf10538d service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-1d7b492f-338a-4c9f-bda7-3d3339bf64aa req-3217e20d-dab9-403b-94de-b68aaf10538d service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing instance network info cache due to event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:25:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1d7b492f-338a-4c9f-bda7-3d3339bf64aa req-3217e20d-dab9-403b-94de-b68aaf10538d service nova] Acquiring lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:25:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1d7b492f-338a-4c9f-bda7-3d3339bf64aa req-3217e20d-dab9-403b-94de-b68aaf10538d service nova] Acquired lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:25:27 user nova-compute[73012]: DEBUG nova.network.neutron [req-1d7b492f-338a-4c9f-bda7-3d3339bf64aa req-3217e20d-dab9-403b-94de-b68aaf10538d service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:25:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:28 user nova-compute[73012]: DEBUG nova.network.neutron [req-1d7b492f-338a-4c9f-bda7-3d3339bf64aa req-3217e20d-dab9-403b-94de-b68aaf10538d service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updated VIF entry in instance network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:25:28 user nova-compute[73012]: DEBUG nova.network.neutron [req-1d7b492f-338a-4c9f-bda7-3d3339bf64aa req-3217e20d-dab9-403b-94de-b68aaf10538d service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updating instance_info_cache with network_info: [{"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:25:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1d7b492f-338a-4c9f-bda7-3d3339bf64aa req-3217e20d-dab9-403b-94de-b68aaf10538d service nova] Releasing lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:25:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-64d8af8a-ccdc-402f-ac5e-abb062d2dfad req-64582e15-09b1-447e-8eaf-1e9e133d03dc service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-64d8af8a-ccdc-402f-ac5e-abb062d2dfad req-64582e15-09b1-447e-8eaf-1e9e133d03dc service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing instance network info cache due to event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:25:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-64d8af8a-ccdc-402f-ac5e-abb062d2dfad req-64582e15-09b1-447e-8eaf-1e9e133d03dc service nova] Acquiring lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:25:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-64d8af8a-ccdc-402f-ac5e-abb062d2dfad req-64582e15-09b1-447e-8eaf-1e9e133d03dc service nova] Acquired lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:25:29 user nova-compute[73012]: DEBUG nova.network.neutron [req-64d8af8a-ccdc-402f-ac5e-abb062d2dfad req-64582e15-09b1-447e-8eaf-1e9e133d03dc service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG nova.network.neutron [req-64d8af8a-ccdc-402f-ac5e-abb062d2dfad req-64582e15-09b1-447e-8eaf-1e9e133d03dc service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updated VIF entry in instance network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG nova.network.neutron [req-64d8af8a-ccdc-402f-ac5e-abb062d2dfad req-64582e15-09b1-447e-8eaf-1e9e133d03dc service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updating instance_info_cache with network_info: [{"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:30 user nova-compute[73012]: INFO nova.compute.manager [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Rebooting instance
Aug 14 12:25:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-64d8af8a-ccdc-402f-ac5e-abb062d2dfad req-64582e15-09b1-447e-8eaf-1e9e133d03dc service nova] Releasing lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquired lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG nova.network.neutron [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG nova.network.neutron [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updating instance_info_cache with network_info: [{"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Releasing lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:25:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-711f377b-c0f3-4429-ba6e-41d545bd5564 req-cea7c37f-644f-4215-8cfa-0731d2f5e921 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-unplugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-711f377b-c0f3-4429-ba6e-41d545bd5564 req-cea7c37f-644f-4215-8cfa-0731d2f5e921 service nova] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-711f377b-c0f3-4429-ba6e-41d545bd5564 req-cea7c37f-644f-4215-8cfa-0731d2f5e921 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-711f377b-c0f3-4429-ba6e-41d545bd5564 req-cea7c37f-644f-4215-8cfa-0731d2f5e921 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-711f377b-c0f3-4429-ba6e-41d545bd5564 req-cea7c37f-644f-4215-8cfa-0731d2f5e921 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] No waiting events found dispatching network-vif-unplugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:33 user nova-compute[73012]: WARNING nova.compute.manager [req-711f377b-c0f3-4429-ba6e-41d545bd5564 req-cea7c37f-644f-4215-8cfa-0731d2f5e921 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received unexpected event network-vif-unplugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 for instance with vm_state active and task_state reboot_started.
Aug 14 12:25:34 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Instance shutdown successfully.
Aug 14 12:25:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] No waiting events found dispatching network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:35 user nova-compute[73012]: WARNING nova.compute.manager [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received unexpected event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 for instance with vm_state active and task_state reboot_started.
Aug 14 12:25:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] No waiting events found dispatching network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:35 user nova-compute[73012]: WARNING nova.compute.manager [req-aca6e747-50f0-4460-aa7b-06944031a7af req-c1fa20c1-3b79-4477-8485-6cf0a7d4ccca service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received unexpected event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 for instance with vm_state active and task_state reboot_started.
Aug 14 12:25:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:36 user nova-compute[73012]: INFO nova.compute.manager [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Terminating instance
Aug 14 12:25:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-3f51d183-bbf9-46df-a65f-ddc5b782711d req-21c1f302-a619-412e-82a2-f66bafdd2407 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-unplugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3f51d183-bbf9-46df-a65f-ddc5b782711d req-21c1f302-a619-412e-82a2-f66bafdd2407 service nova] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3f51d183-bbf9-46df-a65f-ddc5b782711d req-21c1f302-a619-412e-82a2-f66bafdd2407 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3f51d183-bbf9-46df-a65f-ddc5b782711d req-21c1f302-a619-412e-82a2-f66bafdd2407 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-3f51d183-bbf9-46df-a65f-ddc5b782711d req-21c1f302-a619-412e-82a2-f66bafdd2407 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] No waiting events found dispatching network-vif-unplugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-3f51d183-bbf9-46df-a65f-ddc5b782711d req-21c1f302-a619-412e-82a2-f66bafdd2407 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-unplugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Instance destroyed successfully.
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'resources' on Instance uuid ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1536270',display_name='tempest-ServerRescueNegativeTestJSON-server-1536270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1536270',id=15,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:11:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-6d0napzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:11:17Z,user_data=None,user_id='e7128922092841c49b475af30075e458',uuid=ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "address": "fa:16:3e:e6:fd:85", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5e5b4d-d3", "ovs_interfaceid": "8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fd:85,bridge_name='br-int',has_traffic_filtering=True,id=8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5e5b4d-d3') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG os_vif [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fd:85,bridge_name='br-int',has_traffic_filtering=True,id=8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5e5b4d-d3') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e5e5b4d-d3, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:37 user nova-compute[73012]: INFO os_vif [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:fd:85,bridge_name='br-int',has_traffic_filtering=True,id=8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5e5b4d-d3')
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Deleting instance files /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e_del
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Deletion of /opt/stack/data/nova/instances/ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e_del complete
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.compute.manager [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 12:25:37 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for e9be3988-9ba7-448b-b901-19e8aff1fe6a due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015937.5020614, e9be3988-9ba7-448b-b901-19e8aff1fe6a => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] VM Resumed (Lifecycle Event)
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Instance running successfully.
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Instance soft rebooted successfully.
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692015937.5059865, e9be3988-9ba7-448b-b901-19e8aff1fe6a => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] VM Started (Lifecycle Event)
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-64d3b8d6-f6fd-4dbf-9315-5acf79ca7a8d req-559edad7-f3a7-464f-af4f-864a5359ea74 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-64d3b8d6-f6fd-4dbf-9315-5acf79ca7a8d req-559edad7-f3a7-464f-af4f-864a5359ea74 service nova] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-64d3b8d6-f6fd-4dbf-9315-5acf79ca7a8d req-559edad7-f3a7-464f-af4f-864a5359ea74 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-64d3b8d6-f6fd-4dbf-9315-5acf79ca7a8d req-559edad7-f3a7-464f-af4f-864a5359ea74 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-64d3b8d6-f6fd-4dbf-9315-5acf79ca7a8d req-559edad7-f3a7-464f-af4f-864a5359ea74 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] No waiting events found dispatching network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:37 user nova-compute[73012]: WARNING nova.compute.manager [req-64d3b8d6-f6fd-4dbf-9315-5acf79ca7a8d req-559edad7-f3a7-464f-af4f-864a5359ea74 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received unexpected event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 for instance with vm_state active and task_state reboot_started.
Aug 14 12:25:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1e38d4ef-544f-43bd-a7a8-8806238c2ca8 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.417s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:25:37 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Took 0.71 seconds to deallocate network for instance.
Aug 14 12:25:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:38 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:25:38 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:25:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:38 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Deleted allocations for instance ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e
Aug 14 12:25:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-168bd8ea-0d3c-4767-81d5-e69c4eb1d7fe tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-e38cb823-e7bc-4994-a1d2-68a502d60c45 req-83202bde-0081-4557-b9aa-1239b950f470 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e38cb823-e7bc-4994-a1d2-68a502d60c45 req-83202bde-0081-4557-b9aa-1239b950f470 service nova] Acquiring lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e38cb823-e7bc-4994-a1d2-68a502d60c45 req-83202bde-0081-4557-b9aa-1239b950f470 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e38cb823-e7bc-4994-a1d2-68a502d60c45 req-83202bde-0081-4557-b9aa-1239b950f470 service nova] Lock "ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-e38cb823-e7bc-4994-a1d2-68a502d60c45 req-83202bde-0081-4557-b9aa-1239b950f470 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] No waiting events found dispatching network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:38 user nova-compute[73012]: WARNING nova.compute.manager [req-e38cb823-e7bc-4994-a1d2-68a502d60c45 req-83202bde-0081-4557-b9aa-1239b950f470 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received unexpected event network-vif-plugged-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a for instance with vm_state deleted and task_state None.
Aug 14 12:25:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-70867e21-3d6f-40d4-949f-7d4ed9bbcece req-66cb0b0a-742c-4684-89d8-dabfa67a5dd9 service nova] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Received event network-vif-deleted-8e5e5b4d-d3d1-487b-a0c8-67bff87b0a0a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:42 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:43 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:43 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:43 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:25:43 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:43 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:25:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:25:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:25:46 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:25:46 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:25:46 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7630MB free_disk=25.216999053955078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:25:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance c2247c01-f5c8-42f3-9f16-231e7198d4e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 56391331-dd5f-4641-8208-72ba5cd514a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 53ee2aff-68a4-4015-82b3-30e842115c79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e9be3988-9ba7-448b-b901-19e8aff1fe6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 913d1f19-4c67-45dd-92dd-a0a79418eda4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance f71ae265-b116-4048-8549-3bf44c6cdc9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:25:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:49 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:25:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:25:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:25:49 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:25:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updating instance_info_cache with network_info: [{"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:25:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-c2247c01-f5c8-42f3-9f16-231e7198d4e8" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:25:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:25:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:51 user nova-compute[73012]: INFO nova.compute.manager [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Detaching volume 1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a
Aug 14 12:25:51 user nova-compute[73012]: INFO nova.virt.block_device [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Attempting to driver detach volume 1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a from mountpoint /dev/vdb
Aug 14 12:25:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Attempting to detach device vdb from instance 56391331-dd5f-4641-8208-72ba5cd514a4 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:25:51 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:25:51 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:25:51 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:25:51 user nova-compute[73012]:   <serial>1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a</serial>
Aug 14 12:25:51 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 12:25:51 user nova-compute[73012]: </disk>
Aug 14 12:25:51 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:25:51 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully detached device vdb from instance 56391331-dd5f-4641-8208-72ba5cd514a4 from the persistent domain config.
Aug 14 12:25:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56391331-dd5f-4641-8208-72ba5cd514a4 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:25:51 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:25:51 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:25:51 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:25:51 user nova-compute[73012]:   <serial>1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a</serial>
Aug 14 12:25:51 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 12:25:51 user nova-compute[73012]: </disk>
Aug 14 12:25:51 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692015951.8028758, 56391331-dd5f-4641-8208-72ba5cd514a4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:25:51 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully detached device vdb from instance 56391331-dd5f-4641-8208-72ba5cd514a4 from the live domain config.
Aug 14 12:25:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFXIWsSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:25:51 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5daa2c-eb76-426e-9d85-209b286abfb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2e6dbd-65c0-4dea-9f0f-8021d82dffdf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:25:51 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:51 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:25:51 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad078dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aea7ec-ad02-4788-8ce2-c8fe96f6a041]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6d603-4b8e-4d07-be51-dc2795a14930]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f7dac-1c43-4a1d-9bf8-2ce325d520d9]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[091d6201-7211-43c7-897c-55be85c05f75]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0933a92-c8a2-4dae-bc7d-10a0035b6ea5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015937.031398, ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:25:52 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] VM Stopped (Lifecycle Event)
Aug 14 12:25:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-473a55d8-2729-4c46-b713-4b08b88c1150 None None] [instance: ed8ec8ab-f61c-4fb0-b6f6-6f33e6fb4f7e] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8258cd-2090-46b1-8ffa-a2eacf729de5]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260]
Aug 14 12:25:52 user nova-compute[73012]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a, portal: 172.16.0.220,3260] successful.
Aug 14 12:25:52 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8026f5-8aa5-4ffc-a8ad-512f85c1ea4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5c36ea-493f-41c9-88b4-5618beca7cf7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== disconnect_volume: return (276ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:25:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e8c948cd-610d-4190-8319-817469ecabf6 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.872s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-880b17d2-6482-4ff1-8685-b17120e01a23 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-880b17d2-6482-4ff1-8685-b17120e01a23 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-880b17d2-6482-4ff1-8685-b17120e01a23 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-880b17d2-6482-4ff1-8685-b17120e01a23 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73012) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG nova.objects.instance [None req-880b17d2-6482-4ff1-8685-b17120e01a23 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-e09ad556-7e70-48c2-99a3-4691b5a89371 req-66497a7c-64cf-47b8-a427-716ce178fe2e service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-unplugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e09ad556-7e70-48c2-99a3-4691b5a89371 req-66497a7c-64cf-47b8-a427-716ce178fe2e service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e09ad556-7e70-48c2-99a3-4691b5a89371 req-66497a7c-64cf-47b8-a427-716ce178fe2e service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e09ad556-7e70-48c2-99a3-4691b5a89371 req-66497a7c-64cf-47b8-a427-716ce178fe2e service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-e09ad556-7e70-48c2-99a3-4691b5a89371 req-66497a7c-64cf-47b8-a427-716ce178fe2e service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-unplugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:54 user nova-compute[73012]: WARNING nova.compute.manager [req-e09ad556-7e70-48c2-99a3-4691b5a89371 req-66497a7c-64cf-47b8-a427-716ce178fe2e service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-unplugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state active and task_state powering-off.
Aug 14 12:25:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:25:54 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance destroyed successfully.
Aug 14 12:25:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-880b17d2-6482-4ff1-8685-b17120e01a23 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:25:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-880b17d2-6482-4ff1-8685-b17120e01a23 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.903s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-6ca6b62e-3ea4-4e8d-933c-04859e31ae1f req-cb08403e-ca7e-4343-971c-e24bdd9cfe34 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6ca6b62e-3ea4-4e8d-933c-04859e31ae1f req-cb08403e-ca7e-4343-971c-e24bdd9cfe34 service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6ca6b62e-3ea4-4e8d-933c-04859e31ae1f req-cb08403e-ca7e-4343-971c-e24bdd9cfe34 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6ca6b62e-3ea4-4e8d-933c-04859e31ae1f req-cb08403e-ca7e-4343-971c-e24bdd9cfe34 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-6ca6b62e-3ea4-4e8d-933c-04859e31ae1f req-cb08403e-ca7e-4343-971c-e24bdd9cfe34 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:56 user nova-compute[73012]: WARNING nova.compute.manager [req-6ca6b62e-3ea4-4e8d-933c-04859e31ae1f req-cb08403e-ca7e-4343-971c-e24bdd9cfe34 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state stopped and task_state None.
Aug 14 12:25:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "913d1f19-4c67-45dd-92dd-a0a79418eda4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:57 user nova-compute[73012]: INFO nova.compute.manager [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Terminating instance
Aug 14 12:25:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:25:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received event network-vif-unplugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] Acquiring lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] No waiting events found dispatching network-vif-unplugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received event network-vif-unplugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received event network-vif-plugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] Acquiring lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] No waiting events found dispatching network-vif-plugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:25:58 user nova-compute[73012]: WARNING nova.compute.manager [req-7c9913e8-cc3c-4790-b846-6be9735de11a req-752da649-6bdd-4589-af2b-09ab05de819e service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received unexpected event network-vif-plugged-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf for instance with vm_state active and task_state deleting.
Aug 14 12:25:58 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Instance destroyed successfully.
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.objects.instance [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'resources' on Instance uuid 913d1f19-4c67-45dd-92dd-a0a79418eda4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:24:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-535063527',display_name='tempest-TestVolumeBootPattern-server-535063527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-535063527',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-d87qfbct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:24:28Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=913d1f19-4c67-45dd-92dd-a0a79418eda4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "address": "fa:16:3e:f8:0f:db", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3081c14-9f", "ovs_interfaceid": "c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:0f:db,bridge_name='br-int',has_traffic_filtering=True,id=c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3081c14-9f') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_vif [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:0f:db,bridge_name='br-int',has_traffic_filtering=True,id=c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3081c14-9f') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3081c14-9f, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:25:58 user nova-compute[73012]: INFO os_vif [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:0f:db,bridge_name='br-int',has_traffic_filtering=True,id=c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3081c14-9f')
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HdZqXvhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:25:58 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846976c-8a6d-4018-a68b-0a799db6666d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d9b74f-4123-487d-a492-0a44f9706646]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:58 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:58 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:58 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:58 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:25:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:25:58 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:25:58 user nova-compute[73012]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b (non-flash)
Aug 14 12:25:58 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:25:58 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:25:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad012f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf8bd7-d749-4b69-b393-5c4990f03505]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1b66ea-3663-4556-bcb0-fce75a869310]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1711a4-4b6f-4ff3-ba7e-c6471c1763a8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabf295c-295f-4967-9dbc-e431589bb348]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7f4393f2-d302de69a6970621', '/dev/disk/by-id/scsi-26433303264653639', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7f4393f2') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cea55f9-0f4f-4ee9-baca-68e64915487a]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a226c51-cd82-4a5a-be51-cceb668311c5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[23152001-0ab3-4d90-88d3-7e0ad56d94fe]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b, portal: 172.16.0.220,3260]
Aug 14 12:25:58 user nova-compute[73012]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b, portal: 172.16.0.220,3260] successful.
Aug 14 12:25:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4a308b-7ba1-42b4-bc53-20424ca6ba5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[649acac4-a945-421b-a701-25ae49402f77]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== disconnect_volume: return (288ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:25:58 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Deleting instance files /opt/stack/data/nova/instances/913d1f19-4c67-45dd-92dd-a0a79418eda4_del
Aug 14 12:25:58 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Deletion of /opt/stack/data/nova/instances/913d1f19-4c67-45dd-92dd-a0a79418eda4_del complete
Aug 14 12:25:58 user nova-compute[73012]: INFO nova.compute.manager [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 14 12:25:58 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:25:58 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:25:59 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:25:59 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Took 0.59 seconds to deallocate network for instance.
Aug 14 12:25:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0c840e04-7789-41d7-a8bb-294a22a5265f req-13879d9d-f92e-4417-a1cb-75c03005af6e service nova] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Received event network-vif-deleted-c3081c14-9ff5-4bdb-b11c-bf8b377cf3cf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:26:00 user nova-compute[73012]: INFO nova.compute.manager [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Took 0.83 seconds to detach 1 volumes for instance.
Aug 14 12:26:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Deleting volume: 9a4a308b-7ba1-42b4-bc53-20424ca6ba5b {{(pid=73012) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 12:26:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:00 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:26:00 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:26:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:00 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Deleted allocations for instance 913d1f19-4c67-45dd-92dd-a0a79418eda4
Aug 14 12:26:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8590a8a5-b064-4a0c-bad5-7cd523b952ac tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "913d1f19-4c67-45dd-92dd-a0a79418eda4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:04 user nova-compute[73012]: INFO nova.compute.manager [None req-c75fe81a-cae0-44d4-ad0e-1eed9e839efa tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Get console output
Aug 14 12:26:04 user nova-compute[73012]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 14 12:26:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:08 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:09 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015954.4424803, 56391331-dd5f-4641-8208-72ba5cd514a4 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:26:09 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] VM Stopped (Lifecycle Event)
Aug 14 12:26:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-0453dd57-47b5-4ac0-a055-7ac3ca67aaa0 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:26:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-0453dd57-47b5-4ac0-a055-7ac3ca67aaa0 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:26:13 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015958.2597241, 913d1f19-4c67-45dd-92dd-a0a79418eda4 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:26:13 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] VM Stopped (Lifecycle Event)
Aug 14 12:26:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a4b15748-74ff-4e7a-81a2-c861237574f9 None None] [instance: 913d1f19-4c67-45dd-92dd-a0a79418eda4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:26:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:26:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:26:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:26 user nova-compute[73012]: INFO nova.compute.manager [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Terminating instance
Aug 14 12:26:26 user nova-compute[73012]: DEBUG nova.compute.manager [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-69b5de95-6e9c-4484-a5cc-6358e1befb80 req-27ce0d7e-2da2-4fd6-98df-f356c3c393ff service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-unplugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-69b5de95-6e9c-4484-a5cc-6358e1befb80 req-27ce0d7e-2da2-4fd6-98df-f356c3c393ff service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-69b5de95-6e9c-4484-a5cc-6358e1befb80 req-27ce0d7e-2da2-4fd6-98df-f356c3c393ff service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-69b5de95-6e9c-4484-a5cc-6358e1befb80 req-27ce0d7e-2da2-4fd6-98df-f356c3c393ff service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-69b5de95-6e9c-4484-a5cc-6358e1befb80 req-27ce0d7e-2da2-4fd6-98df-f356c3c393ff service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-unplugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:26:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-69b5de95-6e9c-4484-a5cc-6358e1befb80 req-27ce0d7e-2da2-4fd6-98df-f356c3c393ff service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-unplugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:26:27 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Instance destroyed successfully.
Aug 14 12:26:27 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lazy-loading 'resources' on Instance uuid c2247c01-f5c8-42f3-9f16-231e7198d4e8 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-852374389',display_name='tempest-ServerRescueNegativeTestJSON-server-852374389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-852374389',id=14,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:14:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96ac2852176e4d7580080e2320371fe8',ramdisk_id='',reservation_id='r-raidpx0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-334705254',owner_user_name='tempest-ServerRescueNegativeTestJSON-334705254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:16:03Z,user_data=None,user_id='e7128922092841c49b475af30075e458',uuid=c2247c01-f5c8-42f3-9f16-231e7198d4e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converting VIF {"id": "8935f630-5b68-43e3-a48c-ae0f19b19368", "address": "fa:16:3e:9e:12:3c", "network": {"id": "eacced06-21c9-4b97-9a03-b29219fc58e5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-668130938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96ac2852176e4d7580080e2320371fe8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8935f630-5b", "ovs_interfaceid": "8935f630-5b68-43e3-a48c-ae0f19b19368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:12:3c,bridge_name='br-int',has_traffic_filtering=True,id=8935f630-5b68-43e3-a48c-ae0f19b19368,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8935f630-5b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG os_vif [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:12:3c,bridge_name='br-int',has_traffic_filtering=True,id=8935f630-5b68-43e3-a48c-ae0f19b19368,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8935f630-5b') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8935f630-5b, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:27 user nova-compute[73012]: INFO os_vif [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:12:3c,bridge_name='br-int',has_traffic_filtering=True,id=8935f630-5b68-43e3-a48c-ae0f19b19368,network=Network(eacced06-21c9-4b97-9a03-b29219fc58e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8935f630-5b')
Aug 14 12:26:27 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Deleting instance files /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8_del
Aug 14 12:26:27 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Deletion of /opt/stack/data/nova/instances/c2247c01-f5c8-42f3-9f16-231e7198d4e8_del complete
Aug 14 12:26:27 user nova-compute[73012]: INFO nova.compute.manager [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 14 12:26:27 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:26:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:26:28 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Took 0.71 seconds to deallocate network for instance.
Aug 14 12:26:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-552e0de6-ff59-43b6-87f4-6dc141075359 req-b3c91ee1-dc5a-47d5-98e5-8288059728ee service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-deleted-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:28 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Deleted allocations for instance c2247c01-f5c8-42f3-9f16-231e7198d4e8
Aug 14 12:26:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f7dbef15-fedc-430c-8c09-272d1a671d4c tempest-ServerRescueNegativeTestJSON-334705254 tempest-ServerRescueNegativeTestJSON-334705254-project-member] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.837s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-e8264cdf-84ed-4894-8cab-1e4d034da476 req-eb32a43c-2f5f-4dac-9481-e530d9f61e17 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e8264cdf-84ed-4894-8cab-1e4d034da476 req-eb32a43c-2f5f-4dac-9481-e530d9f61e17 service nova] Acquiring lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e8264cdf-84ed-4894-8cab-1e4d034da476 req-eb32a43c-2f5f-4dac-9481-e530d9f61e17 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e8264cdf-84ed-4894-8cab-1e4d034da476 req-eb32a43c-2f5f-4dac-9481-e530d9f61e17 service nova] Lock "c2247c01-f5c8-42f3-9f16-231e7198d4e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:28 user nova-compute[73012]: DEBUG nova.compute.manager [req-e8264cdf-84ed-4894-8cab-1e4d034da476 req-eb32a43c-2f5f-4dac-9481-e530d9f61e17 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] No waiting events found dispatching network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:26:28 user nova-compute[73012]: WARNING nova.compute.manager [req-e8264cdf-84ed-4894-8cab-1e4d034da476 req-eb32a43c-2f5f-4dac-9481-e530d9f61e17 service nova] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Received unexpected event network-vif-plugged-8935f630-5b68-43e3-a48c-ae0f19b19368 for instance with vm_state deleted and task_state None.
Aug 14 12:26:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:34 user nova-compute[73012]: INFO nova.compute.manager [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Rescuing
Aug 14 12:26:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquired lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Updating instance_info_cache with network_info: [{"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Releasing lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-6a1f65de-ca85-47b7-99a3-c4c0b871b4a9 req-775b1295-3361-4dad-bd5f-e3cf60db237b service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-unplugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6a1f65de-ca85-47b7-99a3-c4c0b871b4a9 req-775b1295-3361-4dad-bd5f-e3cf60db237b service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6a1f65de-ca85-47b7-99a3-c4c0b871b4a9 req-775b1295-3361-4dad-bd5f-e3cf60db237b service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6a1f65de-ca85-47b7-99a3-c4c0b871b4a9 req-775b1295-3361-4dad-bd5f-e3cf60db237b service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-6a1f65de-ca85-47b7-99a3-c4c0b871b4a9 req-775b1295-3361-4dad-bd5f-e3cf60db237b service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-unplugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:26:34 user nova-compute[73012]: WARNING nova.compute.manager [req-6a1f65de-ca85-47b7-99a3-c4c0b871b4a9 req-775b1295-3361-4dad-bd5f-e3cf60db237b service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-unplugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state active and task_state rescuing.
Aug 14 12:26:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Instance destroyed successfully.
Aug 14 12:26:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Attempting a stable device rescue
Aug 14 12:26:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73012) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 12:26:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Instance directory exists: not creating {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 12:26:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Creating image(s)
Aug 14 12:26:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "/opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "/opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "/opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:35 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'trusted_certs' on Instance uuid f71ae265-b116-4048-8549-3bf44c6cdc9b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:26:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "e67e325e06fdad408dbdf5a17c4d29609d943c4a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "e67e325e06fdad408dbdf5a17c4d29609d943c4a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a.part --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:36 user nova-compute[73012]: DEBUG nova.virt.images [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] 44af6780-f5a7-4eb6-910a-7386c5593b72 was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:26:36 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:26:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a.part /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c1fc1fc-8154-498e-a973-10703019da68 req-12ae448a-8cd2-4846-9b8d-43d61421a408 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c1fc1fc-8154-498e-a973-10703019da68 req-12ae448a-8cd2-4846-9b8d-43d61421a408 service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c1fc1fc-8154-498e-a973-10703019da68 req-12ae448a-8cd2-4846-9b8d-43d61421a408 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c1fc1fc-8154-498e-a973-10703019da68 req-12ae448a-8cd2-4846-9b8d-43d61421a408 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c1fc1fc-8154-498e-a973-10703019da68 req-12ae448a-8cd2-4846-9b8d-43d61421a408 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:26:37 user nova-compute[73012]: WARNING nova.compute.manager [req-8c1fc1fc-8154-498e-a973-10703019da68 req-12ae448a-8cd2-4846-9b8d-43d61421a408 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state active and task_state rescuing.
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a.part /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a.converted" returned: 0 in 0.325s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "e67e325e06fdad408dbdf5a17c4d29609d943c4a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.698s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "e67e325e06fdad408dbdf5a17c4d29609d943c4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "e67e325e06fdad408dbdf5a17c4d29609d943c4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a,backing_fmt=raw /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a,backing_fmt=raw /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue" returned: 0 in 0.054s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "e67e325e06fdad408dbdf5a17c4d29609d943c4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'migration_context' on Instance uuid f71ae265-b116-4048-8549-3bf44c6cdc9b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Start _get_guest_xml network_info=[{"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "vif_mac": "fa:16:3e:e6:63:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '44af6780-f5a7-4eb6-910a-7386c5593b72', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNjxgpLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'f71ae265-b116-4048-8549-3bf44c6cdc9b', 'attached_at': '', 'detached_at': '', 'volume_id': '7843bf23-ee40-45fe-a3d1-f1ea0450de84', 'serial': '7843bf23-ee40-45fe-a3d1-f1ea0450de84'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'bf0ddea5-f055-4774-9507-ef7b65baba56', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'resources' on Instance uuid f71ae265-b116-4048-8549-3bf44c6cdc9b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'numa_topology' on Instance uuid f71ae265-b116-4048-8549-3bf44c6cdc9b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:26:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:26:37 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'vcpu_model' on Instance uuid f71ae265-b116-4048-8549-3bf44c6cdc9b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNjxgpLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:26:37 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:26:37 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:26:37 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3d692f-451b-43a6-a62c-f01fecbdc526]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rNjxgpLd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 12:26:37 user nova-compute[73012]: node.name = iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84
Aug 14 12:26:37 user nova-compute[73012]: node.tpgt = -1
Aug 14 12:26:37 user nova-compute[73012]: node.startup = automatic
Aug 14 12:26:37 user nova-compute[73012]: node.leading_login = No
Aug 14 12:26:37 user nova-compute[73012]: iface.iscsi_ifacename = default
Aug 14 12:26:37 user nova-compute[73012]: iface.net_ifacename = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.ipaddress = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.prefix_len = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.hwaddress = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.transport_name = tcp
Aug 14 12:26:37 user nova-compute[73012]: iface.initiatorname = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.state = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.vlan_id = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.vlan_priority = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.vlan_state = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.iface_num = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.mtu = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.port = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.bootproto = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.subnet_mask = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.gateway = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.dhcp_alt_client_id = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.dhcp_dns = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.dhcp_learn_iqn = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.dhcp_vendor_id_state = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.dhcp_vendor_id = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.dhcp_slp_da = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.fragmentation = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.gratuitous_arp = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.incoming_forwarding = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.tos_state = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.tos = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.ttl = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.delayed_ack = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.tcp_nagle = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.tcp_wsf_state = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.tcp_wsf = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.tcp_timer_scale = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.tcp_timestamp = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.redirect = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.def_task_mgmt_timeout = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.header_digest = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.data_digest = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.immediate_data = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.initial_r2t = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.data_seq_inorder = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.data_pdu_inorder = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.erl = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.max_receive_data_len = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.first_burst_len = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.max_outstanding_r2t = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.max_burst_len = 0
Aug 14 12:26:37 user nova-compute[73012]: iface.chap_auth = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.bidi_chap = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.strict_login_compliance = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.discovery_auth = <empty>
Aug 14 12:26:37 user nova-compute[73012]: iface.discovery_logout = <empty>
Aug 14 12:26:37 user nova-compute[73012]: node.discovery_address = <empty>
Aug 14 12:26:37 user nova-compute[73012]: node.discovery_port = 0
Aug 14 12:26:37 user nova-compute[73012]: node.discovery_type = static
Aug 14 12:26:37 user nova-compute[73012]: node.session.initial_cmdsn = 0
Aug 14 12:26:37 user nova-compute[73012]: node.session.initial_login_retry_max = 8
Aug 14 12:26:37 user nova-compute[73012]: node.session.xmit_thread_priority = -20
Aug 14 12:26:37 user nova-compute[73012]: node.session.cmds_max = 128
Aug 14 12:26:37 user nova-compute[73012]: node.session.queue_depth = 32
Aug 14 12:26:37 user nova-compute[73012]: node.session.nr_sessions = 1
Aug 14 12:26:37 user nova-compute[73012]: node.session.auth.authmethod = CHAP
Aug 14 12:26:37 user nova-compute[73012]: node.session.auth.username = rNjxgpLd
Aug 14 12:26:37 user nova-compute[73012]: node.session.auth.password = ***
Aug 14 12:26:37 user nova-compute[73012]: node.session.auth.username_in = <empty>
Aug 14 12:26:37 user nova-compute[73012]: node.session.auth.password_in = <empty>
Aug 14 12:26:37 user nova-compute[73012]: node.session.auth.chap_algs = MD5
Aug 14 12:26:37 user nova-compute[73012]: node.session.timeo.replacement_timeout = 120
Aug 14 12:26:37 user nova-compute[73012]: node.session.err_timeo.abort_timeout = 15
Aug 14 12:26:37 user nova-compute[73012]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 12:26:37 user nova-compute[73012]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 12:26:37 user nova-compute[73012]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.FastAbort = Yes
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.InitialR2T = No
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.ImmediateData = Yes
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.MaxConnections = 1
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 12:26:37 user nova-compute[73012]: node.session.iscsi.ERL = 0
Aug 14 12:26:37 user nova-compute[73012]: node.session.scan = manual
Aug 14 12:26:37 user nova-compute[73012]: node.session.reopen_max = 0
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].address = 172.16.0.220
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].port = 3260
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].startup = manual
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].tcp.window_size = 524288
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].tcp.type_of_service = 0
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].timeo.logout_timeout = 15
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].timeo.login_timeout = 15
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].timeo.auth_timeout = 45
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].iscsi.DataDigest = None
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].iscsi.IFMarker = No
Aug 14 12:26:37 user nova-compute[73012]: node.conn[0].iscsi.OFMarker = No
Aug 14 12:26:37 user nova-compute[73012]: # END RECORD
Aug 14 12:26:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bdc715-5906-43aa-bdd0-1e2ad3682598]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[769952fe-ca9a-4585-8855-27e8a8689a24]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNjxgpLd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNjxgpLd" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f00b1ff-92ce-4364-b74f-1d372d75e292]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNjxgpLd'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eed5086-a58b-4bbd-8255-4b4276841490]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[238694c0-fab1-49d3-99dd-731068e37614]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:26:37 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:26:37 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:26:37 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:26:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:26:37 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:26:37 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:26:37 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:26:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.142s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] HCTL ('37', '0', '0', 0) found on session 40 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ed2b5b-cac3-494f-adcc-3cde6f808e7f]: (4, ('0 0 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Searching for a device in session 40 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNjxgpLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] <== connect_volume: return (167ms) {'type': 'block', 'scsi_wwn': '26663666230373961', 'path': '/dev/sdf'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663666230373961', 'path': '/dev/sdf'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1013196602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1013196602',id=34,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-mla0txnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:25:09Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=f71ae265-b116-4048-8549-3bf44c6cdc9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "vif_mac": "fa:16:3e:e6:63:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "vif_mac": "fa:16:3e:e6:63:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=2249834b-3b89-4d69-a520-ac8b00707c36,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2249834b-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'pci_devices' on Instance uuid f71ae265-b116-4048-8549-3bf44c6cdc9b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:26:37 user nova-compute[73012]:   <uuid>f71ae265-b116-4048-8549-3bf44c6cdc9b</uuid>
Aug 14 12:26:37 user nova-compute[73012]:   <name>instance-00000022</name>
Aug 14 12:26:37 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:26:37 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:26:37 user nova-compute[73012]:   <metadata>
Aug 14 12:26:37 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:26:37 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:26:37 user nova-compute[73012]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1013196602</nova:name>
Aug 14 12:26:37 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:26:37</nova:creationTime>
Aug 14 12:26:37 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:26:37 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:26:37 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:26:37 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:26:37 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:26:37 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:26:37 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:26:37 user nova-compute[73012]:       <nova:owner>
Aug 14 12:26:37 user nova-compute[73012]:         <nova:user uuid="ae1ce3345617447486642ebe88c1621c">tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member</nova:user>
Aug 14 12:26:37 user nova-compute[73012]:         <nova:project uuid="6b1960abc96445f483386773f67d83e3">tempest-ServerBootFromVolumeStableRescueTest-1756944789</nova:project>
Aug 14 12:26:37 user nova-compute[73012]:       </nova:owner>
Aug 14 12:26:37 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:26:37 user nova-compute[73012]:       <nova:ports>
Aug 14 12:26:37 user nova-compute[73012]:         <nova:port uuid="2249834b-3b89-4d69-a520-ac8b00707c36">
Aug 14 12:26:37 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 12:26:37 user nova-compute[73012]:         </nova:port>
Aug 14 12:26:37 user nova-compute[73012]:       </nova:ports>
Aug 14 12:26:37 user nova-compute[73012]:     </nova:instance>
Aug 14 12:26:37 user nova-compute[73012]:   </metadata>
Aug 14 12:26:37 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:26:37 user nova-compute[73012]:     <system>
Aug 14 12:26:37 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:26:37 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:26:37 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:26:37 user nova-compute[73012]:       <entry name="serial">f71ae265-b116-4048-8549-3bf44c6cdc9b</entry>
Aug 14 12:26:37 user nova-compute[73012]:       <entry name="uuid">f71ae265-b116-4048-8549-3bf44c6cdc9b</entry>
Aug 14 12:26:37 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:26:37 user nova-compute[73012]:     </system>
Aug 14 12:26:37 user nova-compute[73012]:   </sysinfo>
Aug 14 12:26:37 user nova-compute[73012]:   <os>
Aug 14 12:26:37 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:26:37 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:26:37 user nova-compute[73012]:   </os>
Aug 14 12:26:37 user nova-compute[73012]:   <features>
Aug 14 12:26:37 user nova-compute[73012]:     <acpi/>
Aug 14 12:26:37 user nova-compute[73012]:     <apic/>
Aug 14 12:26:37 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:26:37 user nova-compute[73012]:   </features>
Aug 14 12:26:37 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:26:37 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:26:37 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:26:37 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:26:37 user nova-compute[73012]:   </clock>
Aug 14 12:26:37 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:26:37 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:26:37 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:26:37 user nova-compute[73012]:   </cpu>
Aug 14 12:26:37 user nova-compute[73012]:   <devices>
Aug 14 12:26:37 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:26:37 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:26:37 user nova-compute[73012]:       <source dev="/dev/sdf"/>
Aug 14 12:26:37 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:26:37 user nova-compute[73012]:       <serial>7843bf23-ee40-45fe-a3d1-f1ea0450de84</serial>
Aug 14 12:26:37 user nova-compute[73012]:     </disk>
Aug 14 12:26:37 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:26:37 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:26:37 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue"/>
Aug 14 12:26:37 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:26:37 user nova-compute[73012]:       <boot order="1"/>
Aug 14 12:26:37 user nova-compute[73012]:     </disk>
Aug 14 12:26:37 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:26:37 user nova-compute[73012]:       <mac address="fa:16:3e:e6:63:5d"/>
Aug 14 12:26:37 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:26:37 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:26:37 user nova-compute[73012]:       <target dev="tap2249834b-3b"/>
Aug 14 12:26:37 user nova-compute[73012]:     </interface>
Aug 14 12:26:37 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:26:37 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/console.log" append="off"/>
Aug 14 12:26:37 user nova-compute[73012]:     </serial>
Aug 14 12:26:37 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:26:37 user nova-compute[73012]:     <video>
Aug 14 12:26:37 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:26:37 user nova-compute[73012]:     </video>
Aug 14 12:26:37 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:26:37 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:26:37 user nova-compute[73012]:     </rng>
Aug 14 12:26:37 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:26:37 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:26:37 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:26:37 user nova-compute[73012]:     </memballoon>
Aug 14 12:26:37 user nova-compute[73012]:   </devices>
Aug 14 12:26:37 user nova-compute[73012]: </domain>
Aug 14 12:26:37 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:26:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Instance destroyed successfully.
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:26:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] No VIF found with MAC fa:16:3e:e6:63:5d, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-908e19a5-9525-47b8-8482-56aa12c937ba req-edda84eb-e93d-4c1e-9bf5-c08b2fd71e2c service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-908e19a5-9525-47b8-8482-56aa12c937ba req-edda84eb-e93d-4c1e-9bf5-c08b2fd71e2c service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-908e19a5-9525-47b8-8482-56aa12c937ba req-edda84eb-e93d-4c1e-9bf5-c08b2fd71e2c service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-908e19a5-9525-47b8-8482-56aa12c937ba req-edda84eb-e93d-4c1e-9bf5-c08b2fd71e2c service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG nova.compute.manager [req-908e19a5-9525-47b8-8482-56aa12c937ba req-edda84eb-e93d-4c1e-9bf5-c08b2fd71e2c service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:26:39 user nova-compute[73012]: WARNING nova.compute.manager [req-908e19a5-9525-47b8-8482-56aa12c937ba req-edda84eb-e93d-4c1e-9bf5-c08b2fd71e2c service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state active and task_state rescuing.
Aug 14 12:26:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:39 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for f71ae265-b116-4048-8549-3bf44c6cdc9b due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016001.3940587, f71ae265-b116-4048-8549-3bf44c6cdc9b => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:26:41 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] VM Resumed (Lifecycle Event)
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e214ec41-a728-46c3-af6d-7ed4a98e9c4b tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:26:41 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016001.395599, f71ae265-b116-4048-8549-3bf44c6cdc9b => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:26:41 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] VM Started (Lifecycle Event)
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-54321ccf-b47b-45ed-b13e-7ff37c6bbaad req-28ce9fcc-347e-4c09-9355-cde8dfa78c52 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54321ccf-b47b-45ed-b13e-7ff37c6bbaad req-28ce9fcc-347e-4c09-9355-cde8dfa78c52 service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54321ccf-b47b-45ed-b13e-7ff37c6bbaad req-28ce9fcc-347e-4c09-9355-cde8dfa78c52 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54321ccf-b47b-45ed-b13e-7ff37c6bbaad req-28ce9fcc-347e-4c09-9355-cde8dfa78c52 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-54321ccf-b47b-45ed-b13e-7ff37c6bbaad req-28ce9fcc-347e-4c09-9355-cde8dfa78c52 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:26:41 user nova-compute[73012]: WARNING nova.compute.manager [req-54321ccf-b47b-45ed-b13e-7ff37c6bbaad req-28ce9fcc-347e-4c09-9355-cde8dfa78c52 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state rescued and task_state None.
Aug 14 12:26:42 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692015987.2230716, c2247c01-f5c8-42f3-9f16-231e7198d4e8 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:26:42 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] VM Stopped (Lifecycle Event)
Aug 14 12:26:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8b96fc9c-71e9-4908-8ee3-479252c26c11 None None] [instance: c2247c01-f5c8-42f3-9f16-231e7198d4e8] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:26:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:44 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:44 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:26:48 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:26:48 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8043MB free_disk=25.148513793945312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 56391331-dd5f-4641-8208-72ba5cd514a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 53ee2aff-68a4-4015-82b3-30e842115c79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e9be3988-9ba7-448b-b901-19e8aff1fe6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance f71ae265-b116-4048-8549-3bf44c6cdc9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:26:48 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:26:49 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:26:49 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:26:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:26:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updating instance_info_cache with network_info: [{"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:26:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:26:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:26:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:26:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:26:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:27:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:05 user nova-compute[73012]: INFO nova.compute.manager [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Terminating instance
Aug 14 12:27:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:27:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-35f61ac3-c723-444a-b1ec-8cd3309040e5 req-71d92441-bd5e-4879-b780-25654db2815e service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-unplugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-35f61ac3-c723-444a-b1ec-8cd3309040e5 req-71d92441-bd5e-4879-b780-25654db2815e service nova] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-35f61ac3-c723-444a-b1ec-8cd3309040e5 req-71d92441-bd5e-4879-b780-25654db2815e service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-35f61ac3-c723-444a-b1ec-8cd3309040e5 req-71d92441-bd5e-4879-b780-25654db2815e service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-35f61ac3-c723-444a-b1ec-8cd3309040e5 req-71d92441-bd5e-4879-b780-25654db2815e service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] No waiting events found dispatching network-vif-unplugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-35f61ac3-c723-444a-b1ec-8cd3309040e5 req-71d92441-bd5e-4879-b780-25654db2815e service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-unplugged-de4870b2-3985-4363-bdc8-364805f9568a for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:27:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Instance destroyed successfully.
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.objects.instance [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'resources' on Instance uuid 53ee2aff-68a4-4015-82b3-30e842115c79 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269061199',display_name='tempest-ServerActionsTestOtherA-server-1269061199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269061199',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFloYN1ReWoKPyBlc0SLCyu4ynKhd4hHFwk9GiyUMnITdI9Vxx2/nsK5EMWhGjgXLC4h+Dyjic41yKG1TsZ9FF3dSkrQKzlOkDc47k70qj4dK+sgWipPTYpvmqVW5R9Xg==',key_name='tempest-keypair-1585640726',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-2r7zlbth',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:24:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=53ee2aff-68a4-4015-82b3-30e842115c79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "de4870b2-3985-4363-bdc8-364805f9568a", "address": "fa:16:3e:0f:c2:c2", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4870b2-39", "ovs_interfaceid": "de4870b2-3985-4363-bdc8-364805f9568a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_vif [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde4870b2-39, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:06 user nova-compute[73012]: INFO os_vif [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:c2:c2,bridge_name='br-int',has_traffic_filtering=True,id=de4870b2-3985-4363-bdc8-364805f9568a,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4870b2-39')
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKYLRuEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:27:06 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f8fa46-e9c2-4933-8c2f-615cec77767f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bac7ae-42c0-40b0-a538-b0cfe669c081]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:27:06 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:27:06 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:27:06 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:27:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:27:06 user nova-compute[73012]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 (non-flash)
Aug 14 12:27:06 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:27:06 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:27:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad06b4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61'): ({'sde'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Removing single pathed devices sde {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50b208f-89f8-4fb3-8fd4-97d2eca1ce88]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e77d82c-6dda-4c54-a064-cbcbe0c44113]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Flushing IO for device /dev/sde {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[699a423f-046b-4bff-baae-f75bce7e3f41]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8be5417-0144-46e7-93a3-e260c97cbc1b]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26231333638306439', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1b011b37', '/dev/disk/by-id/scsi-1SCST_BIO1b011b37-b13680d94489a234') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c629139c-b8de-4218-8244-6d5b84629f94]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5f3665-49c4-4490-8735-f3e05baf28bb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[de277d9b-05a6-417a-99b3-e3fb0c5fa377]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260]
Aug 14 12:27:06 user nova-compute[73012]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61, portal: 172.16.0.220,3260] successful.
Aug 14 12:27:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2283305a-807b-4e5e-afe8-8aa2346a3d61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e3d6d5-48ea-48b8-976c-e48026f2d461]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] <== disconnect_volume: return (311ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:27:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Deleting instance files /opt/stack/data/nova/instances/53ee2aff-68a4-4015-82b3-30e842115c79_del
Aug 14 12:27:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Deletion of /opt/stack/data/nova/instances/53ee2aff-68a4-4015-82b3-30e842115c79_del complete
Aug 14 12:27:06 user nova-compute[73012]: INFO nova.compute.manager [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 14 12:27:06 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:27:06 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:27:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-1798a90f-ad88-4e8f-86a6-e9c6a3aec97c req-e29673ce-e9b6-4d81-907f-a64590805696 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1798a90f-ad88-4e8f-86a6-e9c6a3aec97c req-e29673ce-e9b6-4d81-907f-a64590805696 service nova] Acquiring lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1798a90f-ad88-4e8f-86a6-e9c6a3aec97c req-e29673ce-e9b6-4d81-907f-a64590805696 service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1798a90f-ad88-4e8f-86a6-e9c6a3aec97c req-e29673ce-e9b6-4d81-907f-a64590805696 service nova] Lock "53ee2aff-68a4-4015-82b3-30e842115c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-1798a90f-ad88-4e8f-86a6-e9c6a3aec97c req-e29673ce-e9b6-4d81-907f-a64590805696 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] No waiting events found dispatching network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:27:08 user nova-compute[73012]: WARNING nova.compute.manager [req-1798a90f-ad88-4e8f-86a6-e9c6a3aec97c req-e29673ce-e9b6-4d81-907f-a64590805696 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received unexpected event network-vif-plugged-de4870b2-3985-4363-bdc8-364805f9568a for instance with vm_state active and task_state deleting.
Aug 14 12:27:08 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:27:08 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Took 1.46 seconds to deallocate network for instance.
Aug 14 12:27:09 user nova-compute[73012]: INFO nova.compute.manager [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Took 0.77 seconds to detach 1 volumes for instance.
Aug 14 12:27:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Deleting volume: 2283305a-807b-4e5e-afe8-8aa2346a3d61 {{(pid=73012) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 12:27:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:09 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:27:09 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:27:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:09 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Deleted allocations for instance 53ee2aff-68a4-4015-82b3-30e842115c79
Aug 14 12:27:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-81cb3470-f749-4dd2-979d-7086c6557082 tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "53ee2aff-68a4-4015-82b3-30e842115c79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-0415f3e2-dc4b-49bc-8ae0-cda8e3ba8bd8 req-37afa6dd-af99-4a1c-8797-a218c87843b9 service nova] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Received event network-vif-deleted-de4870b2-3985-4363-bdc8-364805f9568a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:27:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:27:10 user nova-compute[73012]: INFO nova.compute.claims [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Claim successful on node user
Aug 14 12:27:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:27:11 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:27:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:27:11 user nova-compute[73012]: INFO nova.virt.block_device [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Booting with volume 9e7f68f7-cfda-452f-98ce-8889efc67b01 at /dev/vda
Aug 14 12:27:11 user nova-compute[73012]: DEBUG nova.policy [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0311f0fd37f143739604c409233537fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7699b5c3fcc34a619e5d0d066e8ff642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG os_brick.utils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee2a67-8513-4d2a-87c7-4f3debac2a1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[24033361-c953-4481-a38a-fca0cd4a290c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e11a4-1ab9-4d53-a9bd-c696acad6c8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae5b8f9-6b2f-4d83-8b53-b37cdf5f46ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:27:11 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:27:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b97e60f-d682-4ae3-8781-cb0a170c5c4b]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG os_brick.utils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Updating existing volume attachment record: 235cf25f-edf8-49c4-822c-5c62b0372730 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:27:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Successfully created port: 2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Successfully updated port: 2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "refresh_cache-272f2eb9-ebeb-4246-a5a3-2a2078baebfc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquired lock "refresh_cache-272f2eb9-ebeb-4246-a5a3-2a2078baebfc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-54f2df6b-1dbf-4d9b-a876-943f84ab6d63 req-1a5b681a-4aad-49fa-8f1b-e8d828cc3938 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received event network-changed-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-54f2df6b-1dbf-4d9b-a876-943f84ab6d63 req-1a5b681a-4aad-49fa-8f1b-e8d828cc3938 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Refreshing instance network info cache due to event network-changed-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54f2df6b-1dbf-4d9b-a876-943f84ab6d63 req-1a5b681a-4aad-49fa-8f1b-e8d828cc3938 service nova] Acquiring lock "refresh_cache-272f2eb9-ebeb-4246-a5a3-2a2078baebfc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Updating instance_info_cache with network_info: [{"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Releasing lock "refresh_cache-272f2eb9-ebeb-4246-a5a3-2a2078baebfc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Instance network_info: |[{"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54f2df6b-1dbf-4d9b-a876-943f84ab6d63 req-1a5b681a-4aad-49fa-8f1b-e8d828cc3938 service nova] Acquired lock "refresh_cache-272f2eb9-ebeb-4246-a5a3-2a2078baebfc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:27:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-54f2df6b-1dbf-4d9b-a876-943f84ab6d63 req-1a5b681a-4aad-49fa-8f1b-e8d828cc3938 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Refreshing network info cache for port 2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:27:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-54f2df6b-1dbf-4d9b-a876-943f84ab6d63 req-1a5b681a-4aad-49fa-8f1b-e8d828cc3938 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Updated VIF entry in instance network info cache for port 2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:27:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-54f2df6b-1dbf-4d9b-a876-943f84ab6d63 req-1a5b681a-4aad-49fa-8f1b-e8d828cc3938 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Updating instance_info_cache with network_info: [{"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:27:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-54f2df6b-1dbf-4d9b-a876-943f84ab6d63 req-1a5b681a-4aad-49fa-8f1b-e8d828cc3938 service nova] Releasing lock "refresh_cache-272f2eb9-ebeb-4246-a5a3-2a2078baebfc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:27:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:27:20 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Creating image(s)
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Ensure instance console log exists: /opt/stack/data/nova/instances/272f2eb9-ebeb-4246-a5a3-2a2078baebfc/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Start _get_guest_xml network_info=[{"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjemrWdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '272f2eb9-ebeb-4246-a5a3-2a2078baebfc', 'attached_at': '', 'detached_at': '', 'volume_id': '9e7f68f7-cfda-452f-98ce-8889efc67b01', 'serial': '9e7f68f7-cfda-452f-98ce-8889efc67b01'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '235cf25f-edf8-49c4-822c-5c62b0372730', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:27:20 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:27:20 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjemrWdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:27:20 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:27:20 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:27:20 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:27:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6752e6d3-d9c1-4b3c-ab22-94c997d1c595]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:27:20 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5577ae3-17d6-4ca2-a378-816424939684]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01] added
Aug 14 12:27:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c076e236-2076-4814-b7bc-e46c57d276df]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4514572d-1450-4672-ae3a-5eea8873bf8b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjemrWdP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjemrWdP" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d51e07c-6551-469a-8a32-ac2326643efa]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VjemrWdP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[748bab07-ae5d-4f70-97f3-ac78f6d5db10]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff11de1-8b9a-4015-bf0f-99da31e64fdb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22329ba-2d22-4051-8de7-40c77f3ec907]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01, portal: 172.16.0.220,3260]
Aug 14 12:27:20 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01, portal: 172.16.0.220,3260] successful.
Aug 14 12:27:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dbd7bb-2966-424c-8927-7e6912d8de70]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83e373e-a3b8-4f75-820a-c8c2142feaf2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:27:20 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba43af32-2e5a-43b2-8761-d971229c2099]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:20 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016026.3344307, 53ee2aff-68a4-4015-82b3-30e842115c79 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:27:21 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] VM Stopped (Lifecycle Event)
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-8a45df02-407a-4317-9dc5-125b15045b12 None None] [instance: 53ee2aff-68a4-4015-82b3-30e842115c79] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjemrWdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26236303266306564', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236303266306564', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:27:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-150243063',display_name='tempest-TestVolumeBootPattern-volume-backed-server-150243063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-150243063',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMheTN4hgwGLkfPk/pEvdKqWt3WbgudDCVi4/rhS0CMIy+mYb+dcrXe/KeapazQLDALjXLF6+idZDbDzVKLl5wzZZcdMi5FdnqyRqO4UZP+ZrruprAx2HFQwSKXESRhUEA==',key_name='tempest-keypair-1008075225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-lbfjnoqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0311f0fd37f143739604c409233537fa',uuid=272f2eb9-ebeb-4246-a5a3-2a2078baebfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:36:30,bridge_name='br-int',has_traffic_filtering=True,id=2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb4b3e5-1c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'pci_devices' on Instance uuid 272f2eb9-ebeb-4246-a5a3-2a2078baebfc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:27:21 user nova-compute[73012]:   <uuid>272f2eb9-ebeb-4246-a5a3-2a2078baebfc</uuid>
Aug 14 12:27:21 user nova-compute[73012]:   <name>instance-00000023</name>
Aug 14 12:27:21 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:27:21 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:27:21 user nova-compute[73012]:   <metadata>
Aug 14 12:27:21 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:27:21 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:27:21 user nova-compute[73012]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-150243063</nova:name>
Aug 14 12:27:21 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:27:20</nova:creationTime>
Aug 14 12:27:21 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:27:21 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:27:21 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:27:21 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:27:21 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:27:21 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:27:21 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:27:21 user nova-compute[73012]:       <nova:owner>
Aug 14 12:27:21 user nova-compute[73012]:         <nova:user uuid="0311f0fd37f143739604c409233537fa">tempest-TestVolumeBootPattern-1572075418-project-member</nova:user>
Aug 14 12:27:21 user nova-compute[73012]:         <nova:project uuid="7699b5c3fcc34a619e5d0d066e8ff642">tempest-TestVolumeBootPattern-1572075418</nova:project>
Aug 14 12:27:21 user nova-compute[73012]:       </nova:owner>
Aug 14 12:27:21 user nova-compute[73012]:       <nova:ports>
Aug 14 12:27:21 user nova-compute[73012]:         <nova:port uuid="2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97">
Aug 14 12:27:21 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 12:27:21 user nova-compute[73012]:         </nova:port>
Aug 14 12:27:21 user nova-compute[73012]:       </nova:ports>
Aug 14 12:27:21 user nova-compute[73012]:     </nova:instance>
Aug 14 12:27:21 user nova-compute[73012]:   </metadata>
Aug 14 12:27:21 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:27:21 user nova-compute[73012]:     <system>
Aug 14 12:27:21 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:27:21 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:27:21 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:27:21 user nova-compute[73012]:       <entry name="serial">272f2eb9-ebeb-4246-a5a3-2a2078baebfc</entry>
Aug 14 12:27:21 user nova-compute[73012]:       <entry name="uuid">272f2eb9-ebeb-4246-a5a3-2a2078baebfc</entry>
Aug 14 12:27:21 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:27:21 user nova-compute[73012]:     </system>
Aug 14 12:27:21 user nova-compute[73012]:   </sysinfo>
Aug 14 12:27:21 user nova-compute[73012]:   <os>
Aug 14 12:27:21 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:27:21 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:27:21 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:27:21 user nova-compute[73012]:   </os>
Aug 14 12:27:21 user nova-compute[73012]:   <features>
Aug 14 12:27:21 user nova-compute[73012]:     <acpi/>
Aug 14 12:27:21 user nova-compute[73012]:     <apic/>
Aug 14 12:27:21 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:27:21 user nova-compute[73012]:   </features>
Aug 14 12:27:21 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:27:21 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:27:21 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:27:21 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:27:21 user nova-compute[73012]:   </clock>
Aug 14 12:27:21 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:27:21 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:27:21 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:27:21 user nova-compute[73012]:   </cpu>
Aug 14 12:27:21 user nova-compute[73012]:   <devices>
Aug 14 12:27:21 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:27:21 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:27:21 user nova-compute[73012]:       <source dev="/dev/sdc"/>
Aug 14 12:27:21 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:27:21 user nova-compute[73012]:       <serial>9e7f68f7-cfda-452f-98ce-8889efc67b01</serial>
Aug 14 12:27:21 user nova-compute[73012]:     </disk>
Aug 14 12:27:21 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:27:21 user nova-compute[73012]:       <mac address="fa:16:3e:e1:36:30"/>
Aug 14 12:27:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:27:21 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:27:21 user nova-compute[73012]:       <target dev="tap2cb4b3e5-1c"/>
Aug 14 12:27:21 user nova-compute[73012]:     </interface>
Aug 14 12:27:21 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:27:21 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/272f2eb9-ebeb-4246-a5a3-2a2078baebfc/console.log" append="off"/>
Aug 14 12:27:21 user nova-compute[73012]:     </serial>
Aug 14 12:27:21 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:27:21 user nova-compute[73012]:     <video>
Aug 14 12:27:21 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:27:21 user nova-compute[73012]:     </video>
Aug 14 12:27:21 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:27:21 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:27:21 user nova-compute[73012]:     </rng>
Aug 14 12:27:21 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:27:21 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:27:21 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:27:21 user nova-compute[73012]:     </memballoon>
Aug 14 12:27:21 user nova-compute[73012]:   </devices>
Aug 14 12:27:21 user nova-compute[73012]: </domain>
Aug 14 12:27:21 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:27:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-150243063',display_name='tempest-TestVolumeBootPattern-volume-backed-server-150243063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-150243063',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMheTN4hgwGLkfPk/pEvdKqWt3WbgudDCVi4/rhS0CMIy+mYb+dcrXe/KeapazQLDALjXLF6+idZDbDzVKLl5wzZZcdMi5FdnqyRqO4UZP+ZrruprAx2HFQwSKXESRhUEA==',key_name='tempest-keypair-1008075225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-lbfjnoqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0311f0fd37f143739604c409233537fa',uuid=272f2eb9-ebeb-4246-a5a3-2a2078baebfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:36:30,bridge_name='br-int',has_traffic_filtering=True,id=2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb4b3e5-1c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG os_vif [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:36:30,bridge_name='br-int',has_traffic_filtering=True,id=2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb4b3e5-1c') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cb4b3e5-1c, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cb4b3e5-1c, col_values=(('external_ids', {'iface-id': '2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:36:30', 'vm-uuid': '272f2eb9-ebeb-4246-a5a3-2a2078baebfc'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:21 user nova-compute[73012]: INFO os_vif [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:36:30,bridge_name='br-int',has_traffic_filtering=True,id=2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb4b3e5-1c')
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:27:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No VIF found with MAC fa:16:3e:e1:36:30, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:27:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-db131c91-3648-4e1c-9cf5-ef745e0f75fa req-9939a01f-3199-4962-b48d-e1a4625d27c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-db131c91-3648-4e1c-9cf5-ef745e0f75fa req-9939a01f-3199-4962-b48d-e1a4625d27c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing instance network info cache due to event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:27:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-db131c91-3648-4e1c-9cf5-ef745e0f75fa req-9939a01f-3199-4962-b48d-e1a4625d27c3 service nova] Acquiring lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:27:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-db131c91-3648-4e1c-9cf5-ef745e0f75fa req-9939a01f-3199-4962-b48d-e1a4625d27c3 service nova] Acquired lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:27:22 user nova-compute[73012]: DEBUG nova.network.neutron [req-db131c91-3648-4e1c-9cf5-ef745e0f75fa req-9939a01f-3199-4962-b48d-e1a4625d27c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-2b79a223-f048-466f-bfb3-54e4bc4432eb req-e8b90dc1-854c-4c77-94c1-235680d6acaf service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received event network-vif-plugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2b79a223-f048-466f-bfb3-54e4bc4432eb req-e8b90dc1-854c-4c77-94c1-235680d6acaf service nova] Acquiring lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2b79a223-f048-466f-bfb3-54e4bc4432eb req-e8b90dc1-854c-4c77-94c1-235680d6acaf service nova] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2b79a223-f048-466f-bfb3-54e4bc4432eb req-e8b90dc1-854c-4c77-94c1-235680d6acaf service nova] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-2b79a223-f048-466f-bfb3-54e4bc4432eb req-e8b90dc1-854c-4c77-94c1-235680d6acaf service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] No waiting events found dispatching network-vif-plugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:27:23 user nova-compute[73012]: WARNING nova.compute.manager [req-2b79a223-f048-466f-bfb3-54e4bc4432eb req-e8b90dc1-854c-4c77-94c1-235680d6acaf service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received unexpected event network-vif-plugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 for instance with vm_state building and task_state spawning.
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.network.neutron [req-db131c91-3648-4e1c-9cf5-ef745e0f75fa req-9939a01f-3199-4962-b48d-e1a4625d27c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updated VIF entry in instance network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.network.neutron [req-db131c91-3648-4e1c-9cf5-ef745e0f75fa req-9939a01f-3199-4962-b48d-e1a4625d27c3 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updating instance_info_cache with network_info: [{"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-db131c91-3648-4e1c-9cf5-ef745e0f75fa req-9939a01f-3199-4962-b48d-e1a4625d27c3 service nova] Releasing lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:24 user nova-compute[73012]: INFO nova.compute.manager [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Detaching volume df46d282-746d-4193-8e75-9e08d6f58020
Aug 14 12:27:24 user nova-compute[73012]: INFO nova.virt.block_device [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Attempting to driver detach volume df46d282-746d-4193-8e75-9e08d6f58020 from mountpoint /dev/vdb
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Attempting to detach device vdb from instance e9be3988-9ba7-448b-b901-19e8aff1fe6a from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:27:24 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:27:24 user nova-compute[73012]:   <source dev="/dev/sdg"/>
Aug 14 12:27:24 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:27:24 user nova-compute[73012]:   <serial>df46d282-746d-4193-8e75-9e08d6f58020</serial>
Aug 14 12:27:24 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:27:24 user nova-compute[73012]: </disk>
Aug 14 12:27:24 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:27:24 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully detached device vdb from instance e9be3988-9ba7-448b-b901-19e8aff1fe6a from the persistent domain config.
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e9be3988-9ba7-448b-b901-19e8aff1fe6a from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:27:24 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:27:24 user nova-compute[73012]:   <source dev="/dev/sdg"/>
Aug 14 12:27:24 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:27:24 user nova-compute[73012]:   <serial>df46d282-746d-4193-8e75-9e08d6f58020</serial>
Aug 14 12:27:24 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:27:24 user nova-compute[73012]: </disk>
Aug 14 12:27:24 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692016044.7172437, e9be3988-9ba7-448b-b901-19e8aff1fe6a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e9be3988-9ba7-448b-b901-19e8aff1fe6a {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:27:24 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully detached device vdb from instance e9be3988-9ba7-448b-b901-19e8aff1fe6a from the live domain config.
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpfRblKH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:27:24 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29a7b4c-4c9a-4d95-bc24-4bafcb8f096b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c228e11d-d179-49b7-a5a2-ad0faf0563c2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:27:24 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:27:24 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:27:24 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:27:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:27:24 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:27:24 user nova-compute[73012]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 (non-flash)
Aug 14 12:27:24 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:27:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aacf02440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020'): ({'sdg'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Removing single pathed devices sdg {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9caf94-9718-4620-a835-90543152e6e5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[58592191-e9eb-4f23-8fad-6b982b36008c]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Flushing IO for device /dev/sdg {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fffc6c-8de3-43f2-8bff-3131d65482ee]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e095d6ba-15fb-480c-bddb-620b32b89e22]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] SCSI volumes sdg have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dfd745-e692-4237-a139-68c326938c7e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-ce5066f5-0473-4d77-a4c0-7ed36c650c86 req-52e0e407-3df7-438e-9f1a-d55af794ebd8 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-ce5066f5-0473-4d77-a4c0-7ed36c650c86 req-52e0e407-3df7-438e-9f1a-d55af794ebd8 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing instance network info cache due to event network-changed-5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ce5066f5-0473-4d77-a4c0-7ed36c650c86 req-52e0e407-3df7-438e-9f1a-d55af794ebd8 service nova] Acquiring lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ce5066f5-0473-4d77-a4c0-7ed36c650c86 req-52e0e407-3df7-438e-9f1a-d55af794ebd8 service nova] Acquired lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:27:24 user nova-compute[73012]: DEBUG nova.network.neutron [req-ce5066f5-0473-4d77-a4c0-7ed36c650c86 req-52e0e407-3df7-438e-9f1a-d55af794ebd8 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Refreshing network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b779bb-6451-47fb-aafa-5ccf1ce2bd7b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020, portal: 172.16.0.220,3260]
Aug 14 12:27:25 user nova-compute[73012]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020, portal: 172.16.0.220,3260] successful.
Aug 14 12:27:25 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df46d282-746d-4193-8e75-9e08d6f58020 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3305a3-b805-4eab-a98d-52b9e783e445]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] <== disconnect_volume: return (309ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016045.2553267, 272f2eb9-ebeb-4246-a5a3-2a2078baebfc => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:27:25 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] VM Resumed (Lifecycle Event)
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:27:25 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Instance spawned successfully.
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:27:25 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016045.256917, 272f2eb9-ebeb-4246-a5a3-2a2078baebfc => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:27:25 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] VM Started (Lifecycle Event)
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:27:25 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:27:25 user nova-compute[73012]: INFO nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Took 5.09 seconds to spawn the instance on the hypervisor.
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:25 user nova-compute[73012]: INFO nova.compute.manager [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Took 14.77 seconds to build instance.
Aug 14 12:27:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-322b1b49-82ae-4431-aab7-e239ced6c67f tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.856s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-ce5066f5-0473-4d77-a4c0-7ed36c650c86 req-52e0e407-3df7-438e-9f1a-d55af794ebd8 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updated VIF entry in instance network info cache for port 5fa0791e-115a-4d36-8152-68c0b1cdaed9. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-ce5066f5-0473-4d77-a4c0-7ed36c650c86 req-52e0e407-3df7-438e-9f1a-d55af794ebd8 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updating instance_info_cache with network_info: [{"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ce5066f5-0473-4d77-a4c0-7ed36c650c86 req-52e0e407-3df7-438e-9f1a-d55af794ebd8 service nova] Releasing lock "refresh_cache-e9be3988-9ba7-448b-b901-19e8aff1fe6a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:25 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'flavor' on Instance uuid e9be3988-9ba7-448b-b901-19e8aff1fe6a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-0b28948c-2f42-44ad-92f9-0eaa1f641ae8 req-5684d15d-c857-4dce-95e7-f00d54f24219 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received event network-vif-plugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0b28948c-2f42-44ad-92f9-0eaa1f641ae8 req-5684d15d-c857-4dce-95e7-f00d54f24219 service nova] Acquiring lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0b28948c-2f42-44ad-92f9-0eaa1f641ae8 req-5684d15d-c857-4dce-95e7-f00d54f24219 service nova] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0b28948c-2f42-44ad-92f9-0eaa1f641ae8 req-5684d15d-c857-4dce-95e7-f00d54f24219 service nova] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-0b28948c-2f42-44ad-92f9-0eaa1f641ae8 req-5684d15d-c857-4dce-95e7-f00d54f24219 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] No waiting events found dispatching network-vif-plugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:27:26 user nova-compute[73012]: WARNING nova.compute.manager [req-0b28948c-2f42-44ad-92f9-0eaa1f641ae8 req-5684d15d-c857-4dce-95e7-f00d54f24219 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received unexpected event network-vif-plugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 for instance with vm_state active and task_state None.
Aug 14 12:27:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f882142c-97af-4105-9f53-9ba1cfac7edf tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.854s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:27:31 user nova-compute[73012]: INFO nova.compute.claims [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Claim successful on node user
Aug 14 12:27:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:27:31 user nova-compute[73012]: DEBUG nova.network.neutron [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:27:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:27:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG nova.policy [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbc96fd6e33b4e4aae1de009a457c08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef9274d18f04a30bb977bb9ef163bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:27:32 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Creating image(s)
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "/opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "/opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "/opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk 1073741824" returned: 0 in 0.051s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Successfully created port: 442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Cannot resize image /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:27:32 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'migration_context' on Instance uuid 57bcdf17-1aee-4623-91f0-4376be5bad3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Ensure instance console log exists: /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Successfully updated port: 442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquired lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-d4d1bfb7-4134-4120-9fdc-86a3ec52bffe req-87e9c8c8-ba71-4f27-aa5e-2a02591bb8d5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received event network-changed-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-d4d1bfb7-4134-4120-9fdc-86a3ec52bffe req-87e9c8c8-ba71-4f27-aa5e-2a02591bb8d5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Refreshing instance network info cache due to event network-changed-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d4d1bfb7-4134-4120-9fdc-86a3ec52bffe req-87e9c8c8-ba71-4f27-aa5e-2a02591bb8d5 service nova] Acquiring lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Updating instance_info_cache with network_info: [{"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Releasing lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Instance network_info: |[{"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d4d1bfb7-4134-4120-9fdc-86a3ec52bffe req-87e9c8c8-ba71-4f27-aa5e-2a02591bb8d5 service nova] Acquired lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.network.neutron [req-d4d1bfb7-4134-4120-9fdc-86a3ec52bffe req-87e9c8c8-ba71-4f27-aa5e-2a02591bb8d5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Refreshing network info cache for port 442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Start _get_guest_xml network_info=[{"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:27:33 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:27:33 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1577890376',display_name='tempest-AttachVolumeNegativeTest-server-1577890376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1577890376',id=36,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOI2k4vTFB1D75peFfi5leVt/b7/mm5rBMi74Ot6PXaVP6PKMa6TQ+qIC/wCxRkR2JtPOo/Ogh1cuE+gaNT0hzueK+NFwQ9ym1lG5mio9MEXwh/0IEtwxhvaEnUcKLpQ+g==',key_name='tempest-keypair-375130110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-6kbbefl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=57bcdf17-1aee-4623-91f0-4376be5bad3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=442347ea-cc5d-4d3f-ac9f-8d87fb735f8a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442347ea-cc') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'pci_devices' on Instance uuid 57bcdf17-1aee-4623-91f0-4376be5bad3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:27:33 user nova-compute[73012]:   <uuid>57bcdf17-1aee-4623-91f0-4376be5bad3a</uuid>
Aug 14 12:27:33 user nova-compute[73012]:   <name>instance-00000024</name>
Aug 14 12:27:33 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:27:33 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:27:33 user nova-compute[73012]:   <metadata>
Aug 14 12:27:33 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:27:33 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:27:33 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1577890376</nova:name>
Aug 14 12:27:33 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:27:33</nova:creationTime>
Aug 14 12:27:33 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:27:33 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:27:33 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:27:33 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:27:33 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:27:33 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:27:33 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:27:33 user nova-compute[73012]:       <nova:owner>
Aug 14 12:27:33 user nova-compute[73012]:         <nova:user uuid="cbc96fd6e33b4e4aae1de009a457c08a">tempest-AttachVolumeNegativeTest-1684368273-project-member</nova:user>
Aug 14 12:27:33 user nova-compute[73012]:         <nova:project uuid="bef9274d18f04a30bb977bb9ef163bc5">tempest-AttachVolumeNegativeTest-1684368273</nova:project>
Aug 14 12:27:33 user nova-compute[73012]:       </nova:owner>
Aug 14 12:27:33 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:27:33 user nova-compute[73012]:       <nova:ports>
Aug 14 12:27:33 user nova-compute[73012]:         <nova:port uuid="442347ea-cc5d-4d3f-ac9f-8d87fb735f8a">
Aug 14 12:27:33 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 12:27:33 user nova-compute[73012]:         </nova:port>
Aug 14 12:27:33 user nova-compute[73012]:       </nova:ports>
Aug 14 12:27:33 user nova-compute[73012]:     </nova:instance>
Aug 14 12:27:33 user nova-compute[73012]:   </metadata>
Aug 14 12:27:33 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:27:33 user nova-compute[73012]:     <system>
Aug 14 12:27:33 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:27:33 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:27:33 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:27:33 user nova-compute[73012]:       <entry name="serial">57bcdf17-1aee-4623-91f0-4376be5bad3a</entry>
Aug 14 12:27:33 user nova-compute[73012]:       <entry name="uuid">57bcdf17-1aee-4623-91f0-4376be5bad3a</entry>
Aug 14 12:27:33 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:27:33 user nova-compute[73012]:     </system>
Aug 14 12:27:33 user nova-compute[73012]:   </sysinfo>
Aug 14 12:27:33 user nova-compute[73012]:   <os>
Aug 14 12:27:33 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:27:33 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:27:33 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:27:33 user nova-compute[73012]:   </os>
Aug 14 12:27:33 user nova-compute[73012]:   <features>
Aug 14 12:27:33 user nova-compute[73012]:     <acpi/>
Aug 14 12:27:33 user nova-compute[73012]:     <apic/>
Aug 14 12:27:33 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:27:33 user nova-compute[73012]:   </features>
Aug 14 12:27:33 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:27:33 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:27:33 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:27:33 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:27:33 user nova-compute[73012]:   </clock>
Aug 14 12:27:33 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:27:33 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:27:33 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:27:33 user nova-compute[73012]:   </cpu>
Aug 14 12:27:33 user nova-compute[73012]:   <devices>
Aug 14 12:27:33 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:27:33 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:27:33 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk"/>
Aug 14 12:27:33 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:27:33 user nova-compute[73012]:     </disk>
Aug 14 12:27:33 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:27:33 user nova-compute[73012]:       <mac address="fa:16:3e:15:2e:71"/>
Aug 14 12:27:33 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:27:33 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:27:33 user nova-compute[73012]:       <target dev="tap442347ea-cc"/>
Aug 14 12:27:33 user nova-compute[73012]:     </interface>
Aug 14 12:27:33 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:27:33 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/console.log" append="off"/>
Aug 14 12:27:33 user nova-compute[73012]:     </serial>
Aug 14 12:27:33 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:27:33 user nova-compute[73012]:     <video>
Aug 14 12:27:33 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:27:33 user nova-compute[73012]:     </video>
Aug 14 12:27:33 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:27:33 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:27:33 user nova-compute[73012]:     </rng>
Aug 14 12:27:33 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:27:33 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:27:33 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:27:33 user nova-compute[73012]:     </memballoon>
Aug 14 12:27:33 user nova-compute[73012]:   </devices>
Aug 14 12:27:33 user nova-compute[73012]: </domain>
Aug 14 12:27:33 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1577890376',display_name='tempest-AttachVolumeNegativeTest-server-1577890376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1577890376',id=36,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOI2k4vTFB1D75peFfi5leVt/b7/mm5rBMi74Ot6PXaVP6PKMa6TQ+qIC/wCxRkR2JtPOo/Ogh1cuE+gaNT0hzueK+NFwQ9ym1lG5mio9MEXwh/0IEtwxhvaEnUcKLpQ+g==',key_name='tempest-keypair-375130110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-6kbbefl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=57bcdf17-1aee-4623-91f0-4376be5bad3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=442347ea-cc5d-4d3f-ac9f-8d87fb735f8a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442347ea-cc') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG os_vif [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=442347ea-cc5d-4d3f-ac9f-8d87fb735f8a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442347ea-cc') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap442347ea-cc, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap442347ea-cc, col_values=(('external_ids', {'iface-id': '442347ea-cc5d-4d3f-ac9f-8d87fb735f8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:2e:71', 'vm-uuid': '57bcdf17-1aee-4623-91f0-4376be5bad3a'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:27:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:33 user nova-compute[73012]: INFO os_vif [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=442347ea-cc5d-4d3f-ac9f-8d87fb735f8a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442347ea-cc')
Aug 14 12:27:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:27:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No VIF found with MAC fa:16:3e:15:2e:71, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:27:34 user nova-compute[73012]: DEBUG nova.network.neutron [req-d4d1bfb7-4134-4120-9fdc-86a3ec52bffe req-87e9c8c8-ba71-4f27-aa5e-2a02591bb8d5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Updated VIF entry in instance network info cache for port 442347ea-cc5d-4d3f-ac9f-8d87fb735f8a. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:27:34 user nova-compute[73012]: DEBUG nova.network.neutron [req-d4d1bfb7-4134-4120-9fdc-86a3ec52bffe req-87e9c8c8-ba71-4f27-aa5e-2a02591bb8d5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Updating instance_info_cache with network_info: [{"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:27:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d4d1bfb7-4134-4120-9fdc-86a3ec52bffe req-87e9c8c8-ba71-4f27-aa5e-2a02591bb8d5 service nova] Releasing lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-1e387706-9641-4b3b-8c06-eb3d303372da req-a9b505b7-05ef-4e6c-bf2f-6dacd990453a service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received event network-vif-plugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1e387706-9641-4b3b-8c06-eb3d303372da req-a9b505b7-05ef-4e6c-bf2f-6dacd990453a service nova] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1e387706-9641-4b3b-8c06-eb3d303372da req-a9b505b7-05ef-4e6c-bf2f-6dacd990453a service nova] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1e387706-9641-4b3b-8c06-eb3d303372da req-a9b505b7-05ef-4e6c-bf2f-6dacd990453a service nova] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-1e387706-9641-4b3b-8c06-eb3d303372da req-a9b505b7-05ef-4e6c-bf2f-6dacd990453a service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] No waiting events found dispatching network-vif-plugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:27:35 user nova-compute[73012]: WARNING nova.compute.manager [req-1e387706-9641-4b3b-8c06-eb3d303372da req-a9b505b7-05ef-4e6c-bf2f-6dacd990453a service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received unexpected event network-vif-plugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a for instance with vm_state building and task_state spawning.
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016057.4933736, 57bcdf17-1aee-4623-91f0-4376be5bad3a => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:27:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] VM Resumed (Lifecycle Event)
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:27:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Instance spawned successfully.
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:27:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016057.5012736, 57bcdf17-1aee-4623-91f0-4376be5bad3a => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:27:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] VM Started (Lifecycle Event)
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-9ed71074-758f-4b42-9032-522d06ce5a18 req-71287873-6a54-45c2-8c6b-4fdc62abd07b service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received event network-vif-plugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9ed71074-758f-4b42-9032-522d06ce5a18 req-71287873-6a54-45c2-8c6b-4fdc62abd07b service nova] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9ed71074-758f-4b42-9032-522d06ce5a18 req-71287873-6a54-45c2-8c6b-4fdc62abd07b service nova] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9ed71074-758f-4b42-9032-522d06ce5a18 req-71287873-6a54-45c2-8c6b-4fdc62abd07b service nova] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-9ed71074-758f-4b42-9032-522d06ce5a18 req-71287873-6a54-45c2-8c6b-4fdc62abd07b service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] No waiting events found dispatching network-vif-plugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:27:37 user nova-compute[73012]: WARNING nova.compute.manager [req-9ed71074-758f-4b42-9032-522d06ce5a18 req-71287873-6a54-45c2-8c6b-4fdc62abd07b service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received unexpected event network-vif-plugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a for instance with vm_state building and task_state spawning.
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:27:37 user nova-compute[73012]: INFO nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 14 12:27:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:27:37 user nova-compute[73012]: INFO nova.compute.manager [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Took 6.25 seconds to build instance.
Aug 14 12:27:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6f87169a-fc82-4a54-8692-74444703f010 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.340s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:41 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:27:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquired lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:27:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:27:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'info_cache' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.network.neutron [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updating instance_info_cache with network_info: [{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Releasing lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:27:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance destroyed successfully.
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'resources' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2032924741',display_name='tempest-AttachVolumeTestJSON-server-2032924741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2032924741',id=29,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI1LgcrTTw70xOoqnvcVDZtsOJhtmBHzQ19Oa/Uqxd3iuk4bkU5QYp2T1jIxwdRxvJI5QFQbqNJLL7XrstdskKAdhSkVcP7b1pJ7XBEdXgRVkMSdfZifb7EmSSsystmLA==',key_name='tempest-keypair-943368399',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-7htr0z6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=56391331-dd5f-4641-8208-72ba5cd514a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG os_vif [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde12db03-27, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:27:45 user nova-compute[73012]: INFO os_vif [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27')
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Start _get_guest_xml network_info=[{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'numa_topology' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:45 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:27:45 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2032924741',display_name='tempest-AttachVolumeTestJSON-server-2032924741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2032924741',id=29,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI1LgcrTTw70xOoqnvcVDZtsOJhtmBHzQ19Oa/Uqxd3iuk4bkU5QYp2T1jIxwdRxvJI5QFQbqNJLL7XrstdskKAdhSkVcP7b1pJ7XBEdXgRVkMSdfZifb7EmSSsystmLA==',key_name='tempest-keypair-943368399',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-7htr0z6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=56391331-dd5f-4641-8208-72ba5cd514a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'pci_devices' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:27:45 user nova-compute[73012]:   <uuid>56391331-dd5f-4641-8208-72ba5cd514a4</uuid>
Aug 14 12:27:45 user nova-compute[73012]:   <name>instance-0000001d</name>
Aug 14 12:27:45 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:27:45 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:27:45 user nova-compute[73012]:   <metadata>
Aug 14 12:27:45 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:27:45 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:27:45 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeTestJSON-server-2032924741</nova:name>
Aug 14 12:27:45 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:27:45</nova:creationTime>
Aug 14 12:27:45 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:27:45 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:27:45 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:27:45 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:27:45 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:27:45 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:27:45 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:27:45 user nova-compute[73012]:       <nova:owner>
Aug 14 12:27:45 user nova-compute[73012]:         <nova:user uuid="aa2eccd1b9c54304aa336bfb3361b782">tempest-AttachVolumeTestJSON-236615257-project-member</nova:user>
Aug 14 12:27:45 user nova-compute[73012]:         <nova:project uuid="cacdb90792d24af296884a7af3d8b1c6">tempest-AttachVolumeTestJSON-236615257</nova:project>
Aug 14 12:27:45 user nova-compute[73012]:       </nova:owner>
Aug 14 12:27:45 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:27:45 user nova-compute[73012]:       <nova:ports>
Aug 14 12:27:45 user nova-compute[73012]:         <nova:port uuid="de12db03-2755-471c-85d9-99fc6d4a0092">
Aug 14 12:27:45 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 12:27:45 user nova-compute[73012]:         </nova:port>
Aug 14 12:27:45 user nova-compute[73012]:       </nova:ports>
Aug 14 12:27:45 user nova-compute[73012]:     </nova:instance>
Aug 14 12:27:45 user nova-compute[73012]:   </metadata>
Aug 14 12:27:45 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:27:45 user nova-compute[73012]:     <system>
Aug 14 12:27:45 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:27:45 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:27:45 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:27:45 user nova-compute[73012]:       <entry name="serial">56391331-dd5f-4641-8208-72ba5cd514a4</entry>
Aug 14 12:27:45 user nova-compute[73012]:       <entry name="uuid">56391331-dd5f-4641-8208-72ba5cd514a4</entry>
Aug 14 12:27:45 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:27:45 user nova-compute[73012]:     </system>
Aug 14 12:27:45 user nova-compute[73012]:   </sysinfo>
Aug 14 12:27:45 user nova-compute[73012]:   <os>
Aug 14 12:27:45 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:27:45 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:27:45 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:27:45 user nova-compute[73012]:   </os>
Aug 14 12:27:45 user nova-compute[73012]:   <features>
Aug 14 12:27:45 user nova-compute[73012]:     <acpi/>
Aug 14 12:27:45 user nova-compute[73012]:     <apic/>
Aug 14 12:27:45 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:27:45 user nova-compute[73012]:   </features>
Aug 14 12:27:45 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:27:45 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:27:45 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:27:45 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:27:45 user nova-compute[73012]:   </clock>
Aug 14 12:27:45 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:27:45 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:27:45 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:27:45 user nova-compute[73012]:   </cpu>
Aug 14 12:27:45 user nova-compute[73012]:   <devices>
Aug 14 12:27:45 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:27:45 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:27:45 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk"/>
Aug 14 12:27:45 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:27:45 user nova-compute[73012]:     </disk>
Aug 14 12:27:45 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:27:45 user nova-compute[73012]:       <mac address="fa:16:3e:08:4b:33"/>
Aug 14 12:27:45 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:27:45 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:27:45 user nova-compute[73012]:       <target dev="tapde12db03-27"/>
Aug 14 12:27:45 user nova-compute[73012]:     </interface>
Aug 14 12:27:45 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:27:45 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/console.log" append="off"/>
Aug 14 12:27:45 user nova-compute[73012]:     </serial>
Aug 14 12:27:45 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:27:45 user nova-compute[73012]:     <video>
Aug 14 12:27:45 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:27:45 user nova-compute[73012]:     </video>
Aug 14 12:27:45 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:27:45 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:27:45 user nova-compute[73012]:     </rng>
Aug 14 12:27:45 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:27:45 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:27:45 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:27:45 user nova-compute[73012]:     </memballoon>
Aug 14 12:27:45 user nova-compute[73012]:   </devices>
Aug 14 12:27:45 user nova-compute[73012]: </domain>
Aug 14 12:27:45 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'trusted_certs' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Cannot resize image /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'migration_context' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2032924741',display_name='tempest-AttachVolumeTestJSON-server-2032924741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2032924741',id=29,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI1LgcrTTw70xOoqnvcVDZtsOJhtmBHzQ19Oa/Uqxd3iuk4bkU5QYp2T1jIxwdRxvJI5QFQbqNJLL7XrstdskKAdhSkVcP7b1pJ7XBEdXgRVkMSdfZifb7EmSSsystmLA==',key_name='tempest-keypair-943368399',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-7htr0z6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=56391331-dd5f-4641-8208-72ba5cd514a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG os_vif [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde12db03-27, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde12db03-27, col_values=(('external_ids', {'iface-id': 'de12db03-2755-471c-85d9-99fc6d4a0092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:4b:33', 'vm-uuid': '56391331-dd5f-4641-8208-72ba5cd514a4'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:27:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:45 user nova-compute[73012]: INFO os_vif [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27')
Aug 14 12:27:46 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:27:46 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:46 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-ea09d923-4a80-4c63-9e93-8f8e1214d73e req-4fecc03c-0dd6-4bb2-b3be-97b833a4ed27 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ea09d923-4a80-4c63-9e93-8f8e1214d73e req-4fecc03c-0dd6-4bb2-b3be-97b833a4ed27 service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ea09d923-4a80-4c63-9e93-8f8e1214d73e req-4fecc03c-0dd6-4bb2-b3be-97b833a4ed27 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ea09d923-4a80-4c63-9e93-8f8e1214d73e req-4fecc03c-0dd6-4bb2-b3be-97b833a4ed27 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-ea09d923-4a80-4c63-9e93-8f8e1214d73e req-4fecc03c-0dd6-4bb2-b3be-97b833a4ed27 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:27:47 user nova-compute[73012]: WARNING nova.compute.manager [req-ea09d923-4a80-4c63-9e93-8f8e1214d73e req-4fecc03c-0dd6-4bb2-b3be-97b833a4ed27 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state stopped and task_state powering-on.
Aug 14 12:27:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016069.46047, 56391331-dd5f-4641-8208-72ba5cd514a4 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:27:49 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] VM Resumed (Lifecycle Event)
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:27:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance rebooted successfully.
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-074ac2dd-f347-4d85-ae81-ea6a2fa39504 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:27:49 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016069.4645913, 56391331-dd5f-4641-8208-72ba5cd514a4 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:27:49 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] VM Started (Lifecycle Event)
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-c9803675-b9dd-4300-81db-27804e1a3086 req-6e18f23e-6a5b-4e32-ba94-beee18fb3bf4 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c9803675-b9dd-4300-81db-27804e1a3086 req-6e18f23e-6a5b-4e32-ba94-beee18fb3bf4 service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c9803675-b9dd-4300-81db-27804e1a3086 req-6e18f23e-6a5b-4e32-ba94-beee18fb3bf4 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c9803675-b9dd-4300-81db-27804e1a3086 req-6e18f23e-6a5b-4e32-ba94-beee18fb3bf4 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-c9803675-b9dd-4300-81db-27804e1a3086 req-6e18f23e-6a5b-4e32-ba94-beee18fb3bf4 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:27:49 user nova-compute[73012]: WARNING nova.compute.manager [req-c9803675-b9dd-4300-81db-27804e1a3086 req-6e18f23e-6a5b-4e32-ba94-beee18fb3bf4 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state active and task_state None.
Aug 14 12:27:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:27:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:27:52 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:27:52 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=25.13475799560547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 66fb72b1-30a9-4be2-b843-7d648fc66e16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 56391331-dd5f-4641-8208-72ba5cd514a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e9be3988-9ba7-448b-b901-19e8aff1fe6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance f71ae265-b116-4048-8549-3bf44c6cdc9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 272f2eb9-ebeb-4246-a5a3-2a2078baebfc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 57bcdf17-1aee-4623-91f0-4376be5bad3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:27:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:27:53 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:27:53 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:27:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:27:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updating instance_info_cache with network_info: [{"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-4f831e0c-5249-461a-a00a-484c59da5a8a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:27:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:27:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:01 user nova-compute[73012]: INFO nova.compute.manager [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Terminating instance
Aug 14 12:28:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:28:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-abb95448-ee24-4e8b-b0d3-8680d8ae0538 req-b4803307-731d-45e0-b6de-f819ebad3656 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received event network-vif-unplugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-abb95448-ee24-4e8b-b0d3-8680d8ae0538 req-b4803307-731d-45e0-b6de-f819ebad3656 service nova] Acquiring lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-abb95448-ee24-4e8b-b0d3-8680d8ae0538 req-b4803307-731d-45e0-b6de-f819ebad3656 service nova] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-abb95448-ee24-4e8b-b0d3-8680d8ae0538 req-b4803307-731d-45e0-b6de-f819ebad3656 service nova] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-abb95448-ee24-4e8b-b0d3-8680d8ae0538 req-b4803307-731d-45e0-b6de-f819ebad3656 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] No waiting events found dispatching network-vif-unplugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-abb95448-ee24-4e8b-b0d3-8680d8ae0538 req-b4803307-731d-45e0-b6de-f819ebad3656 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received event network-vif-unplugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Instance destroyed successfully.
Aug 14 12:28:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lazy-loading 'resources' on Instance uuid 66fb72b1-30a9-4be2-b843-7d648fc66e16 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1566329280',display_name='tempest-ServerActionsTestOtherA-server-1566329280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1566329280',id=13,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFloYN1ReWoKPyBlc0SLCyu4ynKhd4hHFwk9GiyUMnITdI9Vxx2/nsK5EMWhGjgXLC4h+Dyjic41yKG1TsZ9FF3dSkrQKzlOkDc47k70qj4dK+sgWipPTYpvmqVW5R9Xg==',key_name='tempest-keypair-1585640726',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33d5064d145e48eab20dc7ee82bdf779',ramdisk_id='',reservation_id='r-006x45pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-975401032',owner_user_name='tempest-ServerActionsTestOtherA-975401032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:09:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6c467aee6140bda719332345af7ec0',uuid=66fb72b1-30a9-4be2-b843-7d648fc66e16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converting VIF {"id": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "address": "fa:16:3e:e9:31:ef", "network": {"id": "e1ca39bf-24b6-4ef4-9123-8b8f6d455402", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-170270157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d5064d145e48eab20dc7ee82bdf779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705f8ea2-97", "ovs_interfaceid": "705f8ea2-972b-4194-ba28-1a16d9742dc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:31:ef,bridge_name='br-int',has_traffic_filtering=True,id=705f8ea2-972b-4194-ba28-1a16d9742dc4,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705f8ea2-97') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG os_vif [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:31:ef,bridge_name='br-int',has_traffic_filtering=True,id=705f8ea2-972b-4194-ba28-1a16d9742dc4,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705f8ea2-97') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap705f8ea2-97, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:28:02 user nova-compute[73012]: INFO os_vif [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:31:ef,bridge_name='br-int',has_traffic_filtering=True,id=705f8ea2-972b-4194-ba28-1a16d9742dc4,network=Network(e1ca39bf-24b6-4ef4-9123-8b8f6d455402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705f8ea2-97')
Aug 14 12:28:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Deleting instance files /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16_del
Aug 14 12:28:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Deletion of /opt/stack/data/nova/instances/66fb72b1-30a9-4be2-b843-7d648fc66e16_del complete
Aug 14 12:28:02 user nova-compute[73012]: INFO nova.compute.manager [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 12:28:02 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:28:02 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:28:03 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:03 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:28:03 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Took 0.70 seconds to deallocate network for instance.
Aug 14 12:28:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-27ab6ad3-7c7e-4881-ad7e-f4d70eeb66a3 req-df2b52fc-33a5-4e82-a289-d32e0e77f0c1 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received event network-vif-deleted-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:03 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:28:03 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:28:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:03 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Deleted allocations for instance 66fb72b1-30a9-4be2-b843-7d648fc66e16
Aug 14 12:28:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ce3e0826-7fec-45c8-be00-3a19ae4b1fee tempest-ServerActionsTestOtherA-975401032 tempest-ServerActionsTestOtherA-975401032-project-member] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.163s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-1658482b-544c-4e6b-8d9d-63bf86e7826e req-37433206-1df6-4c5b-b863-d4a52274a126 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received event network-vif-plugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1658482b-544c-4e6b-8d9d-63bf86e7826e req-37433206-1df6-4c5b-b863-d4a52274a126 service nova] Acquiring lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1658482b-544c-4e6b-8d9d-63bf86e7826e req-37433206-1df6-4c5b-b863-d4a52274a126 service nova] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1658482b-544c-4e6b-8d9d-63bf86e7826e req-37433206-1df6-4c5b-b863-d4a52274a126 service nova] Lock "66fb72b1-30a9-4be2-b843-7d648fc66e16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-1658482b-544c-4e6b-8d9d-63bf86e7826e req-37433206-1df6-4c5b-b863-d4a52274a126 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] No waiting events found dispatching network-vif-plugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:28:04 user nova-compute[73012]: WARNING nova.compute.manager [req-1658482b-544c-4e6b-8d9d-63bf86e7826e req-37433206-1df6-4c5b-b863-d4a52274a126 service nova] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Received unexpected event network-vif-plugged-705f8ea2-972b-4194-ba28-1a16d9742dc4 for instance with vm_state deleted and task_state None.
Aug 14 12:28:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:17 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016082.6368215, 66fb72b1-30a9-4be2-b843-7d648fc66e16 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:28:17 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] VM Stopped (Lifecycle Event)
Aug 14 12:28:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-429f01ac-2851-4288-89c7-7c055b7539d3 None None] [instance: 66fb72b1-30a9-4be2-b843-7d648fc66e16] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:28:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:19 user nova-compute[73012]: INFO nova.compute.manager [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Terminating instance
Aug 14 12:28:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-ae8900d0-bc28-4ea0-bff5-b2a4856f5d75 req-d62f631c-8bb4-4830-a868-a5129d3942c4 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-unplugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ae8900d0-bc28-4ea0-bff5-b2a4856f5d75 req-d62f631c-8bb4-4830-a868-a5129d3942c4 service nova] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ae8900d0-bc28-4ea0-bff5-b2a4856f5d75 req-d62f631c-8bb4-4830-a868-a5129d3942c4 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ae8900d0-bc28-4ea0-bff5-b2a4856f5d75 req-d62f631c-8bb4-4830-a868-a5129d3942c4 service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-ae8900d0-bc28-4ea0-bff5-b2a4856f5d75 req-d62f631c-8bb4-4830-a868-a5129d3942c4 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] No waiting events found dispatching network-vif-unplugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-ae8900d0-bc28-4ea0-bff5-b2a4856f5d75 req-d62f631c-8bb4-4830-a868-a5129d3942c4 service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-unplugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:28:20 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Instance destroyed successfully.
Aug 14 12:28:20 user nova-compute[73012]: DEBUG nova.objects.instance [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lazy-loading 'resources' on Instance uuid e9be3988-9ba7-448b-b901-19e8aff1fe6a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:23:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-532113124',display_name='tempest-TestMinimumBasicScenario-server-532113124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-532113124',id=32,image_ref='a3e6c7f0-08c4-4fcd-b4b4-7770610a0306',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzVMNcK3ErlmSyE588RmpHmp/E+mxAI+719u3hBwu5NGIz3NOqKloCIju6pe4yTf4PZQqtcHy7mnwxHxQLOzW/qQ7NqlIljMIGn5sn8gSFdFMlzFFGyZfVAL0OgVtXzZQ==',key_name='tempest-TestMinimumBasicScenario-1641617657',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3be304f15a542fc98ed7614001dd016',ramdisk_id='',reservation_id='r-qn48f2z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a3e6c7f0-08c4-4fcd-b4b4-7770610a0306',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1379939828',owner_user_name='tempest-TestMinimumBasicScenario-1379939828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:25:38Z,user_data=None,user_id='0f89f51cc15e4ffb8860f42ddcb44ae1',uuid=e9be3988-9ba7-448b-b901-19e8aff1fe6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converting VIF {"id": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "address": "fa:16:3e:45:53:2f", "network": {"id": "7f969084-5f34-42b6-8b18-5b6f7c98a81e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-139314032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3be304f15a542fc98ed7614001dd016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa0791e-11", "ovs_interfaceid": "5fa0791e-115a-4d36-8152-68c0b1cdaed9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:53:2f,bridge_name='br-int',has_traffic_filtering=True,id=5fa0791e-115a-4d36-8152-68c0b1cdaed9,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa0791e-11') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG os_vif [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:53:2f,bridge_name='br-int',has_traffic_filtering=True,id=5fa0791e-115a-4d36-8152-68c0b1cdaed9,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa0791e-11') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fa0791e-11, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:28:20 user nova-compute[73012]: INFO os_vif [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:53:2f,bridge_name='br-int',has_traffic_filtering=True,id=5fa0791e-115a-4d36-8152-68c0b1cdaed9,network=Network(7f969084-5f34-42b6-8b18-5b6f7c98a81e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa0791e-11')
Aug 14 12:28:20 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Deleting instance files /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a_del
Aug 14 12:28:20 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Deletion of /opt/stack/data/nova/instances/e9be3988-9ba7-448b-b901-19e8aff1fe6a_del complete
Aug 14 12:28:20 user nova-compute[73012]: INFO nova.compute.manager [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 12:28:20 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:28:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:21 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:28:21 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Took 0.86 seconds to deallocate network for instance.
Aug 14 12:28:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:21 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:28:21 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:28:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:22 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Deleted allocations for instance e9be3988-9ba7-448b-b901-19e8aff1fe6a
Aug 14 12:28:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-83cfaa0a-0b1f-40e7-967b-af7e19402135 tempest-TestMinimumBasicScenario-1379939828 tempest-TestMinimumBasicScenario-1379939828-project-member] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-d384ac6c-2fd3-47bd-9b1a-0c4368b07a84 req-9e2d5bf6-426e-4d0b-a4e3-d3226e2fad9a service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d384ac6c-2fd3-47bd-9b1a-0c4368b07a84 req-9e2d5bf6-426e-4d0b-a4e3-d3226e2fad9a service nova] Acquiring lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d384ac6c-2fd3-47bd-9b1a-0c4368b07a84 req-9e2d5bf6-426e-4d0b-a4e3-d3226e2fad9a service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d384ac6c-2fd3-47bd-9b1a-0c4368b07a84 req-9e2d5bf6-426e-4d0b-a4e3-d3226e2fad9a service nova] Lock "e9be3988-9ba7-448b-b901-19e8aff1fe6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-d384ac6c-2fd3-47bd-9b1a-0c4368b07a84 req-9e2d5bf6-426e-4d0b-a4e3-d3226e2fad9a service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] No waiting events found dispatching network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:28:22 user nova-compute[73012]: WARNING nova.compute.manager [req-d384ac6c-2fd3-47bd-9b1a-0c4368b07a84 req-9e2d5bf6-426e-4d0b-a4e3-d3226e2fad9a service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received unexpected event network-vif-plugged-5fa0791e-115a-4d36-8152-68c0b1cdaed9 for instance with vm_state deleted and task_state None.
Aug 14 12:28:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-d384ac6c-2fd3-47bd-9b1a-0c4368b07a84 req-9e2d5bf6-426e-4d0b-a4e3-d3226e2fad9a service nova] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Received event network-vif-deleted-5fa0791e-115a-4d36-8152-68c0b1cdaed9 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:24 user nova-compute[73012]: INFO nova.compute.manager [None req-3a04942e-fe09-40fc-a4ed-bcaefa7eba4a tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Unrescuing
Aug 14 12:28:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3a04942e-fe09-40fc-a4ed-bcaefa7eba4a tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:28:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3a04942e-fe09-40fc-a4ed-bcaefa7eba4a tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquired lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:28:24 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3a04942e-fe09-40fc-a4ed-bcaefa7eba4a tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG nova.network.neutron [None req-3a04942e-fe09-40fc-a4ed-bcaefa7eba4a tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Updating instance_info_cache with network_info: [{"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3a04942e-fe09-40fc-a4ed-bcaefa7eba4a tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Releasing lock "refresh_cache-f71ae265-b116-4048-8549-3bf44c6cdc9b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3a04942e-fe09-40fc-a4ed-bcaefa7eba4a tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'flavor' on Instance uuid f71ae265-b116-4048-8549-3bf44c6cdc9b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-ad2c0d70-5a66-4e13-8c89-075e1e621f95 req-7352ddb0-42d6-4be7-800a-1756e235026e service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-unplugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ad2c0d70-5a66-4e13-8c89-075e1e621f95 req-7352ddb0-42d6-4be7-800a-1756e235026e service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ad2c0d70-5a66-4e13-8c89-075e1e621f95 req-7352ddb0-42d6-4be7-800a-1756e235026e service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ad2c0d70-5a66-4e13-8c89-075e1e621f95 req-7352ddb0-42d6-4be7-800a-1756e235026e service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-ad2c0d70-5a66-4e13-8c89-075e1e621f95 req-7352ddb0-42d6-4be7-800a-1756e235026e service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-unplugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:28:25 user nova-compute[73012]: WARNING nova.compute.manager [req-ad2c0d70-5a66-4e13-8c89-075e1e621f95 req-7352ddb0-42d6-4be7-800a-1756e235026e service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-unplugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:28:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Instance destroyed successfully.
Aug 14 12:28:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:28:27 user nova-compute[73012]: WARNING nova.compute.manager [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:28:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:28:27 user nova-compute[73012]: WARNING nova.compute.manager [req-465c2772-33d9-4120-86ef-37819b417dab req-524a7c31-a94c-4a79-9943-20d64c159dff service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state rescued and task_state unrescuing.
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Removed pending event for f71ae265-b116-4048-8549-3bf44c6cdc9b due to event {{(pid=73012) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016109.4081511, f71ae265-b116-4048-8549-3bf44c6cdc9b => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:28:29 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] VM Resumed (Lifecycle Event)
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3a04942e-fe09-40fc-a4ed-bcaefa7eba4a tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:28:29 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016109.4127798, f71ae265-b116-4048-8549-3bf44c6cdc9b => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:28:29 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] VM Started (Lifecycle Event)
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-4c83b22d-e781-4189-915d-c8d54fe59967 req-e08fee88-5429-4613-93e0-d85e8e5127db service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:28:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4c83b22d-e781-4189-915d-c8d54fe59967 req-e08fee88-5429-4613-93e0-d85e8e5127db service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4c83b22d-e781-4189-915d-c8d54fe59967 req-e08fee88-5429-4613-93e0-d85e8e5127db service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4c83b22d-e781-4189-915d-c8d54fe59967 req-e08fee88-5429-4613-93e0-d85e8e5127db service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-4c83b22d-e781-4189-915d-c8d54fe59967 req-e08fee88-5429-4613-93e0-d85e8e5127db service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:28:29 user nova-compute[73012]: WARNING nova.compute.manager [req-4c83b22d-e781-4189-915d-c8d54fe59967 req-e08fee88-5429-4613-93e0-d85e8e5127db service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state active and task_state None.
Aug 14 12:28:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:35 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016100.7165887, e9be3988-9ba7-448b-b901-19e8aff1fe6a => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:28:35 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] VM Stopped (Lifecycle Event)
Aug 14 12:28:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-21760710-a734-434c-9cd5-099d34688db3 None None] [instance: e9be3988-9ba7-448b-b901-19e8aff1fe6a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:28:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:28:42 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:28:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:28:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:28:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:28:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:28:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:28:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:28:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:28:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:28:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:28:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:28:48 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:28:48 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7990MB free_disk=25.16189956665039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 56391331-dd5f-4641-8208-72ba5cd514a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance f71ae265-b116-4048-8549-3bf44c6cdc9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 272f2eb9-ebeb-4246-a5a3-2a2078baebfc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 57bcdf17-1aee-4623-91f0-4376be5bad3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:28:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:28:49 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:28:49 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:28:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:28:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:28:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updating instance_info_cache with network_info: [{"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-56391331-dd5f-4641-8208-72ba5cd514a4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:28:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:28:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:28:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-f3e13bf9-2eb0-4166-92b7-0aa99451265d req-d25c7597-9708-4738-b73e-dbd2d0d50b19 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received event network-changed-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-f3e13bf9-2eb0-4166-92b7-0aa99451265d req-d25c7597-9708-4738-b73e-dbd2d0d50b19 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Refreshing instance network info cache due to event network-changed-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:29:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f3e13bf9-2eb0-4166-92b7-0aa99451265d req-d25c7597-9708-4738-b73e-dbd2d0d50b19 service nova] Acquiring lock "refresh_cache-272f2eb9-ebeb-4246-a5a3-2a2078baebfc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:29:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f3e13bf9-2eb0-4166-92b7-0aa99451265d req-d25c7597-9708-4738-b73e-dbd2d0d50b19 service nova] Acquired lock "refresh_cache-272f2eb9-ebeb-4246-a5a3-2a2078baebfc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:29:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-f3e13bf9-2eb0-4166-92b7-0aa99451265d req-d25c7597-9708-4738-b73e-dbd2d0d50b19 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Refreshing network info cache for port 2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:29:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-f3e13bf9-2eb0-4166-92b7-0aa99451265d req-d25c7597-9708-4738-b73e-dbd2d0d50b19 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Updated VIF entry in instance network info cache for port 2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:29:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-f3e13bf9-2eb0-4166-92b7-0aa99451265d req-d25c7597-9708-4738-b73e-dbd2d0d50b19 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Updating instance_info_cache with network_info: [{"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f3e13bf9-2eb0-4166-92b7-0aa99451265d req-d25c7597-9708-4738-b73e-dbd2d0d50b19 service nova] Releasing lock "refresh_cache-272f2eb9-ebeb-4246-a5a3-2a2078baebfc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:29:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:29:08 user nova-compute[73012]: INFO nova.compute.claims [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Claim successful on node user
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:29:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:29:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Creating image(s)
Aug 14 12:29:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "/opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "/opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk 1073741824" returned: 0 in 0.053s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG nova.policy [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84931e0fc1e64b1fb176f88e0a5fffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a071f634fe4f46aaab5408abc931ac4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.204s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Cannot resize image /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'migration_context' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Ensure instance console log exists: /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Successfully created port: 29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Successfully updated port: 29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquired lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-f36c9f83-91ca-4dc2-8edf-9ba48dc3448f req-286b793c-b610-4e6e-923b-9296ed24cc7c service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-changed-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-f36c9f83-91ca-4dc2-8edf-9ba48dc3448f req-286b793c-b610-4e6e-923b-9296ed24cc7c service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Refreshing instance network info cache due to event network-changed-29ec9f44-ed38-45b5-bafe-41aff2453e83. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f36c9f83-91ca-4dc2-8edf-9ba48dc3448f req-286b793c-b610-4e6e-923b-9296ed24cc7c service nova] Acquiring lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:29:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Releasing lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance network_info: |[{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f36c9f83-91ca-4dc2-8edf-9ba48dc3448f req-286b793c-b610-4e6e-923b-9296ed24cc7c service nova] Acquired lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.network.neutron [req-f36c9f83-91ca-4dc2-8edf-9ba48dc3448f req-286b793c-b610-4e6e-923b-9296ed24cc7c service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Refreshing network info cache for port 29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Start _get_guest_xml network_info=[{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:29:11 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:29:11 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-683919669',display_name='tempest-ServerActionsTestOtherB-server-683919669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-683919669',id=37,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVjrJiYPu6VYHnut5LdA0Riwd5ahrXlC4jKtuzbgu4gaPK7GwJ6AlbseM7ClHweAl3Etw8IhYAGZR1UXBZkzmwzGLDvStrigStIDDCoqd0aV5jAHV9FbuiI+5NM0Xr4Q==',key_name='tempest-keypair-284235109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a071f634fe4f46aaab5408abc931ac4b',ramdisk_id='',reservation_id='r-70vm0iqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-539296427',owner_user_name='tempest-ServerActionsTestOtherB-539296427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:29:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84931e0fc1e64b1fb176f88e0a5fffb9',uuid=6c72a6b0-188c-486a-b6c8-4f2c0d2ae371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converting VIF {"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:29:11 user nova-compute[73012]:   <uuid>6c72a6b0-188c-486a-b6c8-4f2c0d2ae371</uuid>
Aug 14 12:29:11 user nova-compute[73012]:   <name>instance-00000025</name>
Aug 14 12:29:11 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:29:11 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:29:11 user nova-compute[73012]:   <metadata>
Aug 14 12:29:11 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:29:11 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:29:11 user nova-compute[73012]:       <nova:name>tempest-ServerActionsTestOtherB-server-683919669</nova:name>
Aug 14 12:29:11 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:29:11</nova:creationTime>
Aug 14 12:29:11 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:29:11 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:29:11 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:29:11 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:29:11 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:29:11 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:29:11 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:29:11 user nova-compute[73012]:       <nova:owner>
Aug 14 12:29:11 user nova-compute[73012]:         <nova:user uuid="84931e0fc1e64b1fb176f88e0a5fffb9">tempest-ServerActionsTestOtherB-539296427-project-member</nova:user>
Aug 14 12:29:11 user nova-compute[73012]:         <nova:project uuid="a071f634fe4f46aaab5408abc931ac4b">tempest-ServerActionsTestOtherB-539296427</nova:project>
Aug 14 12:29:11 user nova-compute[73012]:       </nova:owner>
Aug 14 12:29:11 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:29:11 user nova-compute[73012]:       <nova:ports>
Aug 14 12:29:11 user nova-compute[73012]:         <nova:port uuid="29ec9f44-ed38-45b5-bafe-41aff2453e83">
Aug 14 12:29:11 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:29:11 user nova-compute[73012]:         </nova:port>
Aug 14 12:29:11 user nova-compute[73012]:       </nova:ports>
Aug 14 12:29:11 user nova-compute[73012]:     </nova:instance>
Aug 14 12:29:11 user nova-compute[73012]:   </metadata>
Aug 14 12:29:11 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:29:11 user nova-compute[73012]:     <system>
Aug 14 12:29:11 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:29:11 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:29:11 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:29:11 user nova-compute[73012]:       <entry name="serial">6c72a6b0-188c-486a-b6c8-4f2c0d2ae371</entry>
Aug 14 12:29:11 user nova-compute[73012]:       <entry name="uuid">6c72a6b0-188c-486a-b6c8-4f2c0d2ae371</entry>
Aug 14 12:29:11 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:29:11 user nova-compute[73012]:     </system>
Aug 14 12:29:11 user nova-compute[73012]:   </sysinfo>
Aug 14 12:29:11 user nova-compute[73012]:   <os>
Aug 14 12:29:11 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:29:11 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:29:11 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:29:11 user nova-compute[73012]:   </os>
Aug 14 12:29:11 user nova-compute[73012]:   <features>
Aug 14 12:29:11 user nova-compute[73012]:     <acpi/>
Aug 14 12:29:11 user nova-compute[73012]:     <apic/>
Aug 14 12:29:11 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:29:11 user nova-compute[73012]:   </features>
Aug 14 12:29:11 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:29:11 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:29:11 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:29:11 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:29:11 user nova-compute[73012]:   </clock>
Aug 14 12:29:11 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:29:11 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:29:11 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:29:11 user nova-compute[73012]:   </cpu>
Aug 14 12:29:11 user nova-compute[73012]:   <devices>
Aug 14 12:29:11 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:29:11 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:29:11 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk"/>
Aug 14 12:29:11 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:29:11 user nova-compute[73012]:     </disk>
Aug 14 12:29:11 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:29:11 user nova-compute[73012]:       <mac address="fa:16:3e:88:d7:00"/>
Aug 14 12:29:11 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:29:11 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:29:11 user nova-compute[73012]:       <target dev="tap29ec9f44-ed"/>
Aug 14 12:29:11 user nova-compute[73012]:     </interface>
Aug 14 12:29:11 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:29:11 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/console.log" append="off"/>
Aug 14 12:29:11 user nova-compute[73012]:     </serial>
Aug 14 12:29:11 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:29:11 user nova-compute[73012]:     <video>
Aug 14 12:29:11 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:29:11 user nova-compute[73012]:     </video>
Aug 14 12:29:11 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:29:11 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:29:11 user nova-compute[73012]:     </rng>
Aug 14 12:29:11 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:29:11 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:29:11 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:29:11 user nova-compute[73012]:     </memballoon>
Aug 14 12:29:11 user nova-compute[73012]:   </devices>
Aug 14 12:29:11 user nova-compute[73012]: </domain>
Aug 14 12:29:11 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-683919669',display_name='tempest-ServerActionsTestOtherB-server-683919669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-683919669',id=37,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVjrJiYPu6VYHnut5LdA0Riwd5ahrXlC4jKtuzbgu4gaPK7GwJ6AlbseM7ClHweAl3Etw8IhYAGZR1UXBZkzmwzGLDvStrigStIDDCoqd0aV5jAHV9FbuiI+5NM0Xr4Q==',key_name='tempest-keypair-284235109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a071f634fe4f46aaab5408abc931ac4b',ramdisk_id='',reservation_id='r-70vm0iqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-539296427',owner_user_name='tempest-ServerActionsTestOtherB-539296427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:29:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84931e0fc1e64b1fb176f88e0a5fffb9',uuid=6c72a6b0-188c-486a-b6c8-4f2c0d2ae371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converting VIF {"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG os_vif [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29ec9f44-ed, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29ec9f44-ed, col_values=(('external_ids', {'iface-id': '29ec9f44-ed38-45b5-bafe-41aff2453e83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:d7:00', 'vm-uuid': '6c72a6b0-188c-486a-b6c8-4f2c0d2ae371'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:11 user nova-compute[73012]: INFO os_vif [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed')
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] No VIF found with MAC fa:16:3e:88:d7:00, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:29:11 user nova-compute[73012]: DEBUG nova.network.neutron [req-f36c9f83-91ca-4dc2-8edf-9ba48dc3448f req-286b793c-b610-4e6e-923b-9296ed24cc7c service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updated VIF entry in instance network info cache for port 29ec9f44-ed38-45b5-bafe-41aff2453e83. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:29:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-f36c9f83-91ca-4dc2-8edf-9ba48dc3448f req-286b793c-b610-4e6e-923b-9296ed24cc7c service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f36c9f83-91ca-4dc2-8edf-9ba48dc3448f req-286b793c-b610-4e6e-923b-9296ed24cc7c service nova] Releasing lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:29:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-3f36b2e5-fc71-465b-9005-1c8b55242a82 req-2c354099-d2b9-47af-9ea5-36ca2774b06f service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3f36b2e5-fc71-465b-9005-1c8b55242a82 req-2c354099-d2b9-47af-9ea5-36ca2774b06f service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3f36b2e5-fc71-465b-9005-1c8b55242a82 req-2c354099-d2b9-47af-9ea5-36ca2774b06f service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3f36b2e5-fc71-465b-9005-1c8b55242a82 req-2c354099-d2b9-47af-9ea5-36ca2774b06f service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-3f36b2e5-fc71-465b-9005-1c8b55242a82 req-2c354099-d2b9-47af-9ea5-36ca2774b06f service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:29:13 user nova-compute[73012]: WARNING nova.compute.manager [req-3f36b2e5-fc71-465b-9005-1c8b55242a82 req-2c354099-d2b9-47af-9ea5-36ca2774b06f service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state building and task_state spawning.
Aug 14 12:29:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "e8c8b03a-918a-4388-9563-389c8ec679dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:29:14 user nova-compute[73012]: INFO nova.compute.claims [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Claim successful on node user
Aug 14 12:29:14 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:29:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:29:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:29:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:29:14 user nova-compute[73012]: INFO nova.virt.block_device [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Booting with volume snapshot 7e57bac3-2e2e-4743-8299-3c1eaaf661c8 at /dev/vda
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.policy [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0311f0fd37f143739604c409233537fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7699b5c3fcc34a619e5d0d066e8ff642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016155.2558284, 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:29:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] VM Resumed (Lifecycle Event)
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:29:15 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance spawned successfully.
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-56746708-b390-4aca-a19d-32b8f11be75b req-80391512-8a1b-4c6d-aff9-355878f05212 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-56746708-b390-4aca-a19d-32b8f11be75b req-80391512-8a1b-4c6d-aff9-355878f05212 service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-56746708-b390-4aca-a19d-32b8f11be75b req-80391512-8a1b-4c6d-aff9-355878f05212 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-56746708-b390-4aca-a19d-32b8f11be75b req-80391512-8a1b-4c6d-aff9-355878f05212 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-56746708-b390-4aca-a19d-32b8f11be75b req-80391512-8a1b-4c6d-aff9-355878f05212 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:29:15 user nova-compute[73012]: WARNING nova.compute.manager [req-56746708-b390-4aca-a19d-32b8f11be75b req-80391512-8a1b-4c6d-aff9-355878f05212 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state building and task_state spawning.
Aug 14 12:29:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016155.26457, 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:29:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] VM Started (Lifecycle Event)
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:29:15 user nova-compute[73012]: INFO nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:29:15 user nova-compute[73012]: INFO nova.compute.manager [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Took 7.12 seconds to build instance.
Aug 14 12:29:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7a97c7b8-a7df-43a3-b8bf-54b7a7397df8 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.224s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:15 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Successfully created port: 376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:29:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:16 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Successfully updated port: 376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:29:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "refresh_cache-e8c8b03a-918a-4388-9563-389c8ec679dc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:29:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquired lock "refresh_cache-e8c8b03a-918a-4388-9563-389c8ec679dc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:29:16 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:29:16 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Updating instance_info_cache with network_info: [{"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Releasing lock "refresh_cache-e8c8b03a-918a-4388-9563-389c8ec679dc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Instance network_info: |[{"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG nova.compute.manager [req-4f139738-b1ae-4734-abdd-42b59a41bad9 req-1cf5e4d4-9a65-42b2-b7c2-6f2c30bdff4d service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received event network-changed-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG nova.compute.manager [req-4f139738-b1ae-4734-abdd-42b59a41bad9 req-1cf5e4d4-9a65-42b2-b7c2-6f2c30bdff4d service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Refreshing instance network info cache due to event network-changed-376174ee-afd0-41c7-95b5-9e7e31612cba. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f139738-b1ae-4734-abdd-42b59a41bad9 req-1cf5e4d4-9a65-42b2-b7c2-6f2c30bdff4d service nova] Acquiring lock "refresh_cache-e8c8b03a-918a-4388-9563-389c8ec679dc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f139738-b1ae-4734-abdd-42b59a41bad9 req-1cf5e4d4-9a65-42b2-b7c2-6f2c30bdff4d service nova] Acquired lock "refresh_cache-e8c8b03a-918a-4388-9563-389c8ec679dc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG nova.network.neutron [req-4f139738-b1ae-4734-abdd-42b59a41bad9 req-1cf5e4d4-9a65-42b2-b7c2-6f2c30bdff4d service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Refreshing network info cache for port 376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG nova.network.neutron [req-4f139738-b1ae-4734-abdd-42b59a41bad9 req-1cf5e4d4-9a65-42b2-b7c2-6f2c30bdff4d service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Updated VIF entry in instance network info cache for port 376174ee-afd0-41c7-95b5-9e7e31612cba. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG nova.network.neutron [req-4f139738-b1ae-4734-abdd-42b59a41bad9 req-1cf5e4d4-9a65-42b2-b7c2-6f2c30bdff4d service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Updating instance_info_cache with network_info: [{"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4f139738-b1ae-4734-abdd-42b59a41bad9 req-1cf5e4d4-9a65-42b2-b7c2-6f2c30bdff4d service nova] Releasing lock "refresh_cache-e8c8b03a-918a-4388-9563-389c8ec679dc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:29:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG os_brick.utils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2febf6-2ec9-47bc-bd4f-c6735b8b5463]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[923e3fa5-40b6-4267-ac8c-75a2f4f89aa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692684a-7207-49ae-95db-21c1b857b99c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ae100-0461-461c-8bda-750ebac06c61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:29:20 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:29:20 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[90db3909-5593-4519-8bcf-82a6eeeb104b]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG os_brick.utils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:29:20 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Updating existing volume attachment record: 980397ce-926b-47e7-a56f-c66120cc21d7 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:29:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-b928d7df-a177-45bb-85a6-cfa201e04faa req-d7c24786-00a2-4516-af45-01c70e6e6ae5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received event network-changed-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:22 user nova-compute[73012]: DEBUG nova.compute.manager [req-b928d7df-a177-45bb-85a6-cfa201e04faa req-d7c24786-00a2-4516-af45-01c70e6e6ae5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Refreshing instance network info cache due to event network-changed-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:29:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b928d7df-a177-45bb-85a6-cfa201e04faa req-d7c24786-00a2-4516-af45-01c70e6e6ae5 service nova] Acquiring lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:29:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b928d7df-a177-45bb-85a6-cfa201e04faa req-d7c24786-00a2-4516-af45-01c70e6e6ae5 service nova] Acquired lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:29:22 user nova-compute[73012]: DEBUG nova.network.neutron [req-b928d7df-a177-45bb-85a6-cfa201e04faa req-d7c24786-00a2-4516-af45-01c70e6e6ae5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Refreshing network info cache for port 442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:29:23 user nova-compute[73012]: DEBUG nova.network.neutron [req-b928d7df-a177-45bb-85a6-cfa201e04faa req-d7c24786-00a2-4516-af45-01c70e6e6ae5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Updated VIF entry in instance network info cache for port 442347ea-cc5d-4d3f-ac9f-8d87fb735f8a. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:29:23 user nova-compute[73012]: DEBUG nova.network.neutron [req-b928d7df-a177-45bb-85a6-cfa201e04faa req-d7c24786-00a2-4516-af45-01c70e6e6ae5 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Updating instance_info_cache with network_info: [{"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b928d7df-a177-45bb-85a6-cfa201e04faa req-d7c24786-00a2-4516-af45-01c70e6e6ae5 service nova] Releasing lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:29:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'flavor' on Instance uuid 57bcdf17-1aee-4623-91f0-4376be5bad3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:26 user nova-compute[73012]: INFO nova.compute.manager [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Attaching volume 0296d548-8c97-480e-9bbd-f7b614f2189a to /dev/vdb
Aug 14 12:29:26 user nova-compute[73012]: DEBUG os_brick.utils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc13cb9-cbaa-46e2-85b6-04c3b1227a46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e0ecd3-11bd-4a46-a6a4-9aa27534519d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af5026b-68df-413c-9a64-79aca5958fed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4944ed-7f6d-484f-8134-a9b60c8e3cad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:29:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:29:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:29:27 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:29:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a166572-6f19-4e19-b400-4040a3076c2c]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:29:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:29:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:29:27 user nova-compute[73012]: DEBUG os_brick.utils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:29:27 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Updating existing volume attachment record: f2813972-fadb-4252-8537-38acc0bd9787 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:29:29 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Creating image(s)
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Ensure instance console log exists: /opt/stack/data/nova/instances/e8c8b03a-918a-4388-9563-389c8ec679dc/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Start _get_guest_xml network_info=[{"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T12:29:04Z,direct_url=<?>,disk_format='qcow2',id=b71fb6a1-d26e-4cab-bad3-2b4327aef548,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1246886012',owner='7699b5c3fcc34a619e5d0d066e8ff642',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T12:29:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwHVMZsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8c8b03a-918a-4388-9563-389c8ec679dc', 'attached_at': '', 'detached_at': '', 'volume_id': '4c9ab1d0-0f6c-47ae-a5d6-acb537351119', 'serial': '4c9ab1d0-0f6c-47ae-a5d6-acb537351119'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '980397ce-926b-47e7-a56f-c66120cc21d7', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:29:29 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:29:29 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T12:29:04Z,direct_url=<?>,disk_format='qcow2',id=b71fb6a1-d26e-4cab-bad3-2b4327aef548,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1246886012',owner='7699b5c3fcc34a619e5d0d066e8ff642',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T12:29:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:29:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwHVMZsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:29:30 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:29:30 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:29:30 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9b4c42-9f4a-4f37-a488-3935f3d84e3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:29:30 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ab7105-9a47-4ab3-a24f-4bf417347803]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119] added
Aug 14 12:29:30 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9116a34a-f731-4c7d-9f22-0f47d5ebd591]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a233c629-954d-4448-a8e3-0cdda49b9fcf]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwHVMZsv {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwHVMZsv" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42fb960-67ec-49b7-8491-5d7be3bbc7b9]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gwHVMZsv'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d62954-2dbc-431d-97d1-bc0dbfa3d8a4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9056e5b-224a-438e-939f-1d3a566fc0a1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a664254e-169c-4bff-9529-77486d293bac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119, portal: 172.16.0.220,3260]
Aug 14 12:29:30 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119, portal: 172.16.0.220,3260] successful.
Aug 14 12:29:30 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2d98ad-5395-4cab-a057-e13ceb5fe489]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0767e9e2-6d02-4b20-92d0-a76fdf1df8e0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:29:30 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8452e39d-f208-40fd-b3b1-21b3c80a8ed8]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:29:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwHVMZsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23763396230356665', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763396230356665', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1877325043',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1877325043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1877325043',id=38,image_ref='b71fb6a1-d26e-4cab-bad3-2b4327aef548',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7ceiDXPj8sltpvc7QYJJ1VIrKfUlcsPkzb1gutDu+qyLgHFgfemRO0zKajFgOTwiLKqOac74f2+fTRC8LtJ9SBR1/EkugyzSkuiOAo72L+UY8+q2dXpfcifit7+Ykx6w==',key_name='tempest-keypair-2092734238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-aq5v47ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1572075418',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:29:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0311f0fd37f143739604c409233537fa',uuid=e8c8b03a-918a-4388-9563-389c8ec679dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:14:a0,bridge_name='br-int',has_traffic_filtering=True,id=376174ee-afd0-41c7-95b5-9e7e31612cba,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376174ee-af') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.objects.instance [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'pci_devices' on Instance uuid e8c8b03a-918a-4388-9563-389c8ec679dc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:29:31 user nova-compute[73012]:   <uuid>e8c8b03a-918a-4388-9563-389c8ec679dc</uuid>
Aug 14 12:29:31 user nova-compute[73012]:   <name>instance-00000026</name>
Aug 14 12:29:31 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:29:31 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:29:31 user nova-compute[73012]:   <metadata>
Aug 14 12:29:31 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:29:31 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:29:31 user nova-compute[73012]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1877325043</nova:name>
Aug 14 12:29:31 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:29:29</nova:creationTime>
Aug 14 12:29:31 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:29:31 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:29:31 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:29:31 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:29:31 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:29:31 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:29:31 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:29:31 user nova-compute[73012]:       <nova:owner>
Aug 14 12:29:31 user nova-compute[73012]:         <nova:user uuid="0311f0fd37f143739604c409233537fa">tempest-TestVolumeBootPattern-1572075418-project-member</nova:user>
Aug 14 12:29:31 user nova-compute[73012]:         <nova:project uuid="7699b5c3fcc34a619e5d0d066e8ff642">tempest-TestVolumeBootPattern-1572075418</nova:project>
Aug 14 12:29:31 user nova-compute[73012]:       </nova:owner>
Aug 14 12:29:31 user nova-compute[73012]:       <nova:root type="image" uuid="b71fb6a1-d26e-4cab-bad3-2b4327aef548"/>
Aug 14 12:29:31 user nova-compute[73012]:       <nova:ports>
Aug 14 12:29:31 user nova-compute[73012]:         <nova:port uuid="376174ee-afd0-41c7-95b5-9e7e31612cba">
Aug 14 12:29:31 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 12:29:31 user nova-compute[73012]:         </nova:port>
Aug 14 12:29:31 user nova-compute[73012]:       </nova:ports>
Aug 14 12:29:31 user nova-compute[73012]:     </nova:instance>
Aug 14 12:29:31 user nova-compute[73012]:   </metadata>
Aug 14 12:29:31 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:29:31 user nova-compute[73012]:     <system>
Aug 14 12:29:31 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:29:31 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:29:31 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:29:31 user nova-compute[73012]:       <entry name="serial">e8c8b03a-918a-4388-9563-389c8ec679dc</entry>
Aug 14 12:29:31 user nova-compute[73012]:       <entry name="uuid">e8c8b03a-918a-4388-9563-389c8ec679dc</entry>
Aug 14 12:29:31 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:29:31 user nova-compute[73012]:     </system>
Aug 14 12:29:31 user nova-compute[73012]:   </sysinfo>
Aug 14 12:29:31 user nova-compute[73012]:   <os>
Aug 14 12:29:31 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:29:31 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:29:31 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:29:31 user nova-compute[73012]:   </os>
Aug 14 12:29:31 user nova-compute[73012]:   <features>
Aug 14 12:29:31 user nova-compute[73012]:     <acpi/>
Aug 14 12:29:31 user nova-compute[73012]:     <apic/>
Aug 14 12:29:31 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:29:31 user nova-compute[73012]:   </features>
Aug 14 12:29:31 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:29:31 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:29:31 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:29:31 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:29:31 user nova-compute[73012]:   </clock>
Aug 14 12:29:31 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:29:31 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:29:31 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:29:31 user nova-compute[73012]:   </cpu>
Aug 14 12:29:31 user nova-compute[73012]:   <devices>
Aug 14 12:29:31 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:29:31 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:29:31 user nova-compute[73012]:       <source dev="/dev/sdd"/>
Aug 14 12:29:31 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:29:31 user nova-compute[73012]:       <serial>4c9ab1d0-0f6c-47ae-a5d6-acb537351119</serial>
Aug 14 12:29:31 user nova-compute[73012]:     </disk>
Aug 14 12:29:31 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:29:31 user nova-compute[73012]:       <mac address="fa:16:3e:f1:14:a0"/>
Aug 14 12:29:31 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:29:31 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:29:31 user nova-compute[73012]:       <target dev="tap376174ee-af"/>
Aug 14 12:29:31 user nova-compute[73012]:     </interface>
Aug 14 12:29:31 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:29:31 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/e8c8b03a-918a-4388-9563-389c8ec679dc/console.log" append="off"/>
Aug 14 12:29:31 user nova-compute[73012]:     </serial>
Aug 14 12:29:31 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:29:31 user nova-compute[73012]:     <video>
Aug 14 12:29:31 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:29:31 user nova-compute[73012]:     </video>
Aug 14 12:29:31 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:29:31 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:29:31 user nova-compute[73012]:     </rng>
Aug 14 12:29:31 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:29:31 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:29:31 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:29:31 user nova-compute[73012]:     </memballoon>
Aug 14 12:29:31 user nova-compute[73012]:   </devices>
Aug 14 12:29:31 user nova-compute[73012]: </domain>
Aug 14 12:29:31 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1877325043',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1877325043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1877325043',id=38,image_ref='b71fb6a1-d26e-4cab-bad3-2b4327aef548',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7ceiDXPj8sltpvc7QYJJ1VIrKfUlcsPkzb1gutDu+qyLgHFgfemRO0zKajFgOTwiLKqOac74f2+fTRC8LtJ9SBR1/EkugyzSkuiOAo72L+UY8+q2dXpfcifit7+Ykx6w==',key_name='tempest-keypair-2092734238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-aq5v47ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1572075418',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:29:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0311f0fd37f143739604c409233537fa',uuid=e8c8b03a-918a-4388-9563-389c8ec679dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:14:a0,bridge_name='br-int',has_traffic_filtering=True,id=376174ee-afd0-41c7-95b5-9e7e31612cba,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376174ee-af') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG os_vif [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:14:a0,bridge_name='br-int',has_traffic_filtering=True,id=376174ee-afd0-41c7-95b5-9e7e31612cba,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376174ee-af') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap376174ee-af, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap376174ee-af, col_values=(('external_ids', {'iface-id': '376174ee-afd0-41c7-95b5-9e7e31612cba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:14:a0', 'vm-uuid': 'e8c8b03a-918a-4388-9563-389c8ec679dc'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:31 user nova-compute[73012]: INFO os_vif [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:14:a0,bridge_name='br-int',has_traffic_filtering=True,id=376174ee-afd0-41c7-95b5-9e7e31612cba,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376174ee-af')
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:29:31 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No VIF found with MAC fa:16:3e:f1:14:a0, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:29:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-85924c94-e503-41e0-916e-d9837e947b99 req-05aaef92-f02e-40ce-a82b-f4f3fbb6f00b service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received event network-vif-plugged-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-85924c94-e503-41e0-916e-d9837e947b99 req-05aaef92-f02e-40ce-a82b-f4f3fbb6f00b service nova] Acquiring lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-85924c94-e503-41e0-916e-d9837e947b99 req-05aaef92-f02e-40ce-a82b-f4f3fbb6f00b service nova] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-85924c94-e503-41e0-916e-d9837e947b99 req-05aaef92-f02e-40ce-a82b-f4f3fbb6f00b service nova] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-85924c94-e503-41e0-916e-d9837e947b99 req-05aaef92-f02e-40ce-a82b-f4f3fbb6f00b service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] No waiting events found dispatching network-vif-plugged-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:29:33 user nova-compute[73012]: WARNING nova.compute.manager [req-85924c94-e503-41e0-916e-d9837e947b99 req-05aaef92-f02e-40ce-a82b-f4f3fbb6f00b service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received unexpected event network-vif-plugged-376174ee-afd0-41c7-95b5-9e7e31612cba for instance with vm_state building and task_state spawning.
Aug 14 12:29:34 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016174.9378977, e8c8b03a-918a-4388-9563-389c8ec679dc => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:29:34 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] VM Resumed (Lifecycle Event)
Aug 14 12:29:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:29:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:29:34 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Instance spawned successfully.
Aug 14 12:29:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:29:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:29:35 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:29:35 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016174.940074, e8c8b03a-918a-4388-9563-389c8ec679dc => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:29:35 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] VM Started (Lifecycle Event)
Aug 14 12:29:35 user nova-compute[73012]: INFO nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 14 12:29:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:29:35 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:29:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-5f709839-adf7-40b0-b4fe-00a38c21c0e1 req-3774a9b7-2676-4fe5-b961-8cdc2a90cc31 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received event network-vif-plugged-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5f709839-adf7-40b0-b4fe-00a38c21c0e1 req-3774a9b7-2676-4fe5-b961-8cdc2a90cc31 service nova] Acquiring lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5f709839-adf7-40b0-b4fe-00a38c21c0e1 req-3774a9b7-2676-4fe5-b961-8cdc2a90cc31 service nova] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5f709839-adf7-40b0-b4fe-00a38c21c0e1 req-3774a9b7-2676-4fe5-b961-8cdc2a90cc31 service nova] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-5f709839-adf7-40b0-b4fe-00a38c21c0e1 req-3774a9b7-2676-4fe5-b961-8cdc2a90cc31 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] No waiting events found dispatching network-vif-plugged-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:29:35 user nova-compute[73012]: WARNING nova.compute.manager [req-5f709839-adf7-40b0-b4fe-00a38c21c0e1 req-3774a9b7-2676-4fe5-b961-8cdc2a90cc31 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received unexpected event network-vif-plugged-376174ee-afd0-41c7-95b5-9e7e31612cba for instance with vm_state building and task_state spawning.
Aug 14 12:29:35 user nova-compute[73012]: INFO nova.compute.manager [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Took 20.78 seconds to build instance.
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bbfaafd2-a94a-4943-999d-225268765b69 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.878s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:35 user nova-compute[73012]: INFO nova.compute.manager [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Terminating instance
Aug 14 12:29:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJjGkPZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:29:35 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:29:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:29:35 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:29:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:29:35 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[754dcc6a-3ba9-4385-8ac7-a2198a059262]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:29:35 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdbebcc-63c9-405e-81d8-8049c529ecd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a] added
Aug 14 12:29:36 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f79697-83f7-4e2a-9936-203b45ee40ef]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df48a77-e31e-461f-bf0c-54af864af634]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJjGkPZi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-cb1c7b9b-fd75-42b9-9ebb-7316c4d929c9 req-947b841b-8aaf-4966-81c1-12f1eeeb89f4 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-unplugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cb1c7b9b-fd75-42b9-9ebb-7316c4d929c9 req-947b841b-8aaf-4966-81c1-12f1eeeb89f4 service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cb1c7b9b-fd75-42b9-9ebb-7316c4d929c9 req-947b841b-8aaf-4966-81c1-12f1eeeb89f4 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cb1c7b9b-fd75-42b9-9ebb-7316c4d929c9 req-947b841b-8aaf-4966-81c1-12f1eeeb89f4 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-cb1c7b9b-fd75-42b9-9ebb-7316c4d929c9 req-947b841b-8aaf-4966-81c1-12f1eeeb89f4 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-unplugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-cb1c7b9b-fd75-42b9-9ebb-7316c4d929c9 req-947b841b-8aaf-4966-81c1-12f1eeeb89f4 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-unplugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJjGkPZi" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[df87c56d-c91e-45bb-bb9a-50ad6bd6af5a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UJjGkPZi'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58001b9-690e-45e1-a7d2-60ffc06311f5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2e85f2-0263-4dbd-b41c-5dc8f6f1f355]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63831f3-41f9-4e46-8da9-1866aa0ee546]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a, portal: 172.16.0.220,3260]
Aug 14 12:29:36 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a, portal: 172.16.0.220,3260] successful.
Aug 14 12:29:36 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b7a50e-b7b0-4ab1-bd6c-189c8efac58e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddd6662-9839-49cc-bbf0-48a369b31809]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:29:36 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:29:36 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:29:36 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[91762d16-3722-46a8-a03b-1b530beb9b1f]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:36 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Instance destroyed successfully.
Aug 14 12:29:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'resources' on Instance uuid 56391331-dd5f-4641-8208-72ba5cd514a4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2032924741',display_name='tempest-AttachVolumeTestJSON-server-2032924741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2032924741',id=29,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI1LgcrTTw70xOoqnvcVDZtsOJhtmBHzQ19Oa/Uqxd3iuk4bkU5QYp2T1jIxwdRxvJI5QFQbqNJLL7XrstdskKAdhSkVcP7b1pJ7XBEdXgRVkMSdfZifb7EmSSsystmLA==',key_name='tempest-keypair-943368399',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-7htr0z6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=56391331-dd5f-4641-8208-72ba5cd514a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "de12db03-2755-471c-85d9-99fc6d4a0092", "address": "fa:16:3e:08:4b:33", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde12db03-27", "ovs_interfaceid": "de12db03-2755-471c-85d9-99fc6d4a0092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG os_vif [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde12db03-27, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:29:36 user nova-compute[73012]: INFO os_vif [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=de12db03-2755-471c-85d9-99fc6d4a0092,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde12db03-27')
Aug 14 12:29:36 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Deleting instance files /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4_del
Aug 14 12:29:36 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Deletion of /opt/stack/data/nova/instances/56391331-dd5f-4641-8208-72ba5cd514a4_del complete
Aug 14 12:29:36 user nova-compute[73012]: INFO nova.compute.manager [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 12:29:36 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:29:36 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJjGkPZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26537316534326231', 'path': '/dev/sde'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537316534326231', 'path': '/dev/sde'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'flavor' on Instance uuid 57bcdf17-1aee-4623-91f0-4376be5bad3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:29:37 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:29:37 user nova-compute[73012]:   <source dev="/dev/sde"/>
Aug 14 12:29:37 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:29:37 user nova-compute[73012]:   <serial>0296d548-8c97-480e-9bbd-f7b614f2189a</serial>
Aug 14 12:29:37 user nova-compute[73012]: </disk>
Aug 14 12:29:37 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:37 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Took 1.00 seconds to deallocate network for instance.
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-dbd327b9-e6f7-4c1d-99c1-e0feff0e15a3 req-16c96428-fcc1-455b-94f8-f6ba2095c63b service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-deleted-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:37 user nova-compute[73012]: INFO nova.compute.manager [req-dbd327b9-e6f7-4c1d-99c1-e0feff0e15a3 req-16c96428-fcc1-455b-94f8-f6ba2095c63b service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Neutron deleted interface de12db03-2755-471c-85d9-99fc6d4a0092; detaching it from the instance and deleting it from the info cache
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.network.neutron [req-dbd327b9-e6f7-4c1d-99c1-e0feff0e15a3 req-16c96428-fcc1-455b-94f8-f6ba2095c63b service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.compute.manager [req-dbd327b9-e6f7-4c1d-99c1-e0feff0e15a3 req-16c96428-fcc1-455b-94f8-f6ba2095c63b service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Detach interface failed, port_id=de12db03-2755-471c-85d9-99fc6d4a0092, reason: Instance 56391331-dd5f-4641-8208-72ba5cd514a4 could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:29:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No VIF found with MAC fa:16:3e:15:2e:71, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:29:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a125d841-4643-4e68-87e4-24666a2f8083 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.211s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:38 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:29:38 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:29:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-e14a9112-6731-4be3-8e0d-3eace2e9ec24 req-55f81089-331b-4a21-b145-3de630b3b9a5 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e14a9112-6731-4be3-8e0d-3eace2e9ec24 req-55f81089-331b-4a21-b145-3de630b3b9a5 service nova] Acquiring lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e14a9112-6731-4be3-8e0d-3eace2e9ec24 req-55f81089-331b-4a21-b145-3de630b3b9a5 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e14a9112-6731-4be3-8e0d-3eace2e9ec24 req-55f81089-331b-4a21-b145-3de630b3b9a5 service nova] Lock "56391331-dd5f-4641-8208-72ba5cd514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-e14a9112-6731-4be3-8e0d-3eace2e9ec24 req-55f81089-331b-4a21-b145-3de630b3b9a5 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] No waiting events found dispatching network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:29:38 user nova-compute[73012]: WARNING nova.compute.manager [req-e14a9112-6731-4be3-8e0d-3eace2e9ec24 req-55f81089-331b-4a21-b145-3de630b3b9a5 service nova] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Received unexpected event network-vif-plugged-de12db03-2755-471c-85d9-99fc6d4a0092 for instance with vm_state deleted and task_state None.
Aug 14 12:29:38 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Deleted allocations for instance 56391331-dd5f-4641-8208-72ba5cd514a4
Aug 14 12:29:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc815a88-95e5-42cd-970f-de015054127b tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "56391331-dd5f-4641-8208-72ba5cd514a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.520s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "e71333db-30d2-42b9-9de3-316fc5ac7df1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:29:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:41 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:29:41 user nova-compute[73012]: INFO nova.compute.claims [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Claim successful on node user
Aug 14 12:29:42 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:29:42 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:29:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG nova.policy [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbc96fd6e33b4e4aae1de009a457c08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef9274d18f04a30bb977bb9ef163bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:29:42 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Creating image(s)
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "/opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "/opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "/opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk 1073741824" returned: 0 in 0.101s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:42 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.194s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Successfully created port: 683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Cannot resize image /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'migration_context' on Instance uuid e71333db-30d2-42b9-9de3-316fc5ac7df1 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Ensure instance console log exists: /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:43 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Successfully updated port: 683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "refresh_cache-e71333db-30d2-42b9-9de3-316fc5ac7df1" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquired lock "refresh_cache-e71333db-30d2-42b9-9de3-316fc5ac7df1" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-34e83fcd-9d1d-479c-8245-0fa00a13fe4c req-169aa44d-73c7-4397-afff-3ee967f6cbca service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received event network-changed-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-34e83fcd-9d1d-479c-8245-0fa00a13fe4c req-169aa44d-73c7-4397-afff-3ee967f6cbca service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Refreshing instance network info cache due to event network-changed-683204d8-ec01-4012-b79c-853959649a30. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-34e83fcd-9d1d-479c-8245-0fa00a13fe4c req-169aa44d-73c7-4397-afff-3ee967f6cbca service nova] Acquiring lock "refresh_cache-e71333db-30d2-42b9-9de3-316fc5ac7df1" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Updating instance_info_cache with network_info: [{"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Releasing lock "refresh_cache-e71333db-30d2-42b9-9de3-316fc5ac7df1" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Instance network_info: |[{"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-34e83fcd-9d1d-479c-8245-0fa00a13fe4c req-169aa44d-73c7-4397-afff-3ee967f6cbca service nova] Acquired lock "refresh_cache-e71333db-30d2-42b9-9de3-316fc5ac7df1" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-34e83fcd-9d1d-479c-8245-0fa00a13fe4c req-169aa44d-73c7-4397-afff-3ee967f6cbca service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Refreshing network info cache for port 683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Start _get_guest_xml network_info=[{"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:29:44 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:29:44 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-640538091',display_name='tempest-AttachVolumeNegativeTest-server-640538091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-640538091',id=39,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5nzqe2yZwArxhzxvTtIECUg+A38+be5BAzqKLJRCi/WC39hZkzcrmxtErIBc+uvo4qOoNuTbBsR1JcLJA4kGCB3lhvO5/ibpzy4cIPwSJbr3IEihxrcU5sBdgEiaRtLQ==',key_name='tempest-keypair-1647037820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-i8h3yvio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=e71333db-30d2-42b9-9de3-316fc5ac7df1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=683204d8-ec01-4012-b79c-853959649a30,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap683204d8-ec') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'pci_devices' on Instance uuid e71333db-30d2-42b9-9de3-316fc5ac7df1 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:29:44 user nova-compute[73012]:   <uuid>e71333db-30d2-42b9-9de3-316fc5ac7df1</uuid>
Aug 14 12:29:44 user nova-compute[73012]:   <name>instance-00000027</name>
Aug 14 12:29:44 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:29:44 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:29:44 user nova-compute[73012]:   <metadata>
Aug 14 12:29:44 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:29:44 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:29:44 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeNegativeTest-server-640538091</nova:name>
Aug 14 12:29:44 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:29:44</nova:creationTime>
Aug 14 12:29:44 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:29:44 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:29:44 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:29:44 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:29:44 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:29:44 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:29:44 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:29:44 user nova-compute[73012]:       <nova:owner>
Aug 14 12:29:44 user nova-compute[73012]:         <nova:user uuid="cbc96fd6e33b4e4aae1de009a457c08a">tempest-AttachVolumeNegativeTest-1684368273-project-member</nova:user>
Aug 14 12:29:44 user nova-compute[73012]:         <nova:project uuid="bef9274d18f04a30bb977bb9ef163bc5">tempest-AttachVolumeNegativeTest-1684368273</nova:project>
Aug 14 12:29:44 user nova-compute[73012]:       </nova:owner>
Aug 14 12:29:44 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:29:44 user nova-compute[73012]:       <nova:ports>
Aug 14 12:29:44 user nova-compute[73012]:         <nova:port uuid="683204d8-ec01-4012-b79c-853959649a30">
Aug 14 12:29:44 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 12:29:44 user nova-compute[73012]:         </nova:port>
Aug 14 12:29:44 user nova-compute[73012]:       </nova:ports>
Aug 14 12:29:44 user nova-compute[73012]:     </nova:instance>
Aug 14 12:29:44 user nova-compute[73012]:   </metadata>
Aug 14 12:29:44 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:29:44 user nova-compute[73012]:     <system>
Aug 14 12:29:44 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:29:44 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:29:44 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:29:44 user nova-compute[73012]:       <entry name="serial">e71333db-30d2-42b9-9de3-316fc5ac7df1</entry>
Aug 14 12:29:44 user nova-compute[73012]:       <entry name="uuid">e71333db-30d2-42b9-9de3-316fc5ac7df1</entry>
Aug 14 12:29:44 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:29:44 user nova-compute[73012]:     </system>
Aug 14 12:29:44 user nova-compute[73012]:   </sysinfo>
Aug 14 12:29:44 user nova-compute[73012]:   <os>
Aug 14 12:29:44 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:29:44 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:29:44 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:29:44 user nova-compute[73012]:   </os>
Aug 14 12:29:44 user nova-compute[73012]:   <features>
Aug 14 12:29:44 user nova-compute[73012]:     <acpi/>
Aug 14 12:29:44 user nova-compute[73012]:     <apic/>
Aug 14 12:29:44 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:29:44 user nova-compute[73012]:   </features>
Aug 14 12:29:44 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:29:44 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:29:44 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:29:44 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:29:44 user nova-compute[73012]:   </clock>
Aug 14 12:29:44 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:29:44 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:29:44 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:29:44 user nova-compute[73012]:   </cpu>
Aug 14 12:29:44 user nova-compute[73012]:   <devices>
Aug 14 12:29:44 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:29:44 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:29:44 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk"/>
Aug 14 12:29:44 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:29:44 user nova-compute[73012]:     </disk>
Aug 14 12:29:44 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:29:44 user nova-compute[73012]:       <mac address="fa:16:3e:cf:e7:68"/>
Aug 14 12:29:44 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:29:44 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:29:44 user nova-compute[73012]:       <target dev="tap683204d8-ec"/>
Aug 14 12:29:44 user nova-compute[73012]:     </interface>
Aug 14 12:29:44 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:29:44 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/console.log" append="off"/>
Aug 14 12:29:44 user nova-compute[73012]:     </serial>
Aug 14 12:29:44 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:29:44 user nova-compute[73012]:     <video>
Aug 14 12:29:44 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:29:44 user nova-compute[73012]:     </video>
Aug 14 12:29:44 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:29:44 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:29:44 user nova-compute[73012]:     </rng>
Aug 14 12:29:44 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:29:44 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:29:44 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:29:44 user nova-compute[73012]:     </memballoon>
Aug 14 12:29:44 user nova-compute[73012]:   </devices>
Aug 14 12:29:44 user nova-compute[73012]: </domain>
Aug 14 12:29:44 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-640538091',display_name='tempest-AttachVolumeNegativeTest-server-640538091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-640538091',id=39,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5nzqe2yZwArxhzxvTtIECUg+A38+be5BAzqKLJRCi/WC39hZkzcrmxtErIBc+uvo4qOoNuTbBsR1JcLJA4kGCB3lhvO5/ibpzy4cIPwSJbr3IEihxrcU5sBdgEiaRtLQ==',key_name='tempest-keypair-1647037820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-i8h3yvio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=e71333db-30d2-42b9-9de3-316fc5ac7df1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=683204d8-ec01-4012-b79c-853959649a30,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap683204d8-ec') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG os_vif [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=683204d8-ec01-4012-b79c-853959649a30,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap683204d8-ec') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap683204d8-ec, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap683204d8-ec, col_values=(('external_ids', {'iface-id': '683204d8-ec01-4012-b79c-853959649a30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:e7:68', 'vm-uuid': 'e71333db-30d2-42b9-9de3-316fc5ac7df1'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:44 user nova-compute[73012]: INFO os_vif [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=683204d8-ec01-4012-b79c-853959649a30,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap683204d8-ec')
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No VIF found with MAC fa:16:3e:cf:e7:68, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-34e83fcd-9d1d-479c-8245-0fa00a13fe4c req-169aa44d-73c7-4397-afff-3ee967f6cbca service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Updated VIF entry in instance network info cache for port 683204d8-ec01-4012-b79c-853959649a30. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:29:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-34e83fcd-9d1d-479c-8245-0fa00a13fe4c req-169aa44d-73c7-4397-afff-3ee967f6cbca service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Updating instance_info_cache with network_info: [{"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-34e83fcd-9d1d-479c-8245-0fa00a13fe4c req-169aa44d-73c7-4397-afff-3ee967f6cbca service nova] Releasing lock "refresh_cache-e71333db-30d2-42b9-9de3-316fc5ac7df1" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:29:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG nova.compute.manager [req-b482e37d-0daa-4faf-aa37-b34c641568e8 req-c26b2dac-a53a-4674-997b-27604c857f8d service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received event network-vif-plugged-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b482e37d-0daa-4faf-aa37-b34c641568e8 req-c26b2dac-a53a-4674-997b-27604c857f8d service nova] Acquiring lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b482e37d-0daa-4faf-aa37-b34c641568e8 req-c26b2dac-a53a-4674-997b-27604c857f8d service nova] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b482e37d-0daa-4faf-aa37-b34c641568e8 req-c26b2dac-a53a-4674-997b-27604c857f8d service nova] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG nova.compute.manager [req-b482e37d-0daa-4faf-aa37-b34c641568e8 req-c26b2dac-a53a-4674-997b-27604c857f8d service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] No waiting events found dispatching network-vif-plugged-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:29:46 user nova-compute[73012]: WARNING nova.compute.manager [req-b482e37d-0daa-4faf-aa37-b34c641568e8 req-c26b2dac-a53a-4674-997b-27604c857f8d service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received unexpected event network-vif-plugged-683204d8-ec01-4012-b79c-853959649a30 for instance with vm_state building and task_state spawning.
Aug 14 12:29:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:29:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016188.2971492, e71333db-30d2-42b9-9de3-316fc5ac7df1 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:29:48 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] VM Resumed (Lifecycle Event)
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:29:48 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Instance spawned successfully.
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:48 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016188.3105092, e71333db-30d2-42b9-9de3-316fc5ac7df1 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:29:48 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] VM Started (Lifecycle Event)
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:48 user nova-compute[73012]: INFO nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-ea5c1e87-537b-47e9-a5cc-80662884f544 req-aef4c4d2-00be-472d-9fe7-1977de2f45eb service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received event network-vif-plugged-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ea5c1e87-537b-47e9-a5cc-80662884f544 req-aef4c4d2-00be-472d-9fe7-1977de2f45eb service nova] Acquiring lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ea5c1e87-537b-47e9-a5cc-80662884f544 req-aef4c4d2-00be-472d-9fe7-1977de2f45eb service nova] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ea5c1e87-537b-47e9-a5cc-80662884f544 req-aef4c4d2-00be-472d-9fe7-1977de2f45eb service nova] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-ea5c1e87-537b-47e9-a5cc-80662884f544 req-aef4c4d2-00be-472d-9fe7-1977de2f45eb service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] No waiting events found dispatching network-vif-plugged-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:29:48 user nova-compute[73012]: WARNING nova.compute.manager [req-ea5c1e87-537b-47e9-a5cc-80662884f544 req-aef4c4d2-00be-472d-9fe7-1977de2f45eb service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received unexpected event network-vif-plugged-683204d8-ec01-4012-b79c-853959649a30 for instance with vm_state building and task_state spawning.
Aug 14 12:29:48 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:29:48 user nova-compute[73012]: INFO nova.compute.manager [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Took 6.67 seconds to build instance.
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc72a3fc-8215-4b65-aabd-9a3da381a7c2 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.760s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:29:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:29:49 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:29:49 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=25.19632339477539GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance f71ae265-b116-4048-8549-3bf44c6cdc9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 272f2eb9-ebeb-4246-a5a3-2a2078baebfc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 57bcdf17-1aee-4623-91f0-4376be5bad3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e8c8b03a-918a-4388-9563-389c8ec679dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e71333db-30d2-42b9-9de3-316fc5ac7df1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:29:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:29:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:29:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-bf1c2e78-360e-43fe-96f9-46e9d3c030fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:29:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-bf1c2e78-360e-43fe-96f9-46e9d3c030fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:29:50 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:29:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Updating instance_info_cache with network_info: [{"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:29:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-bf1c2e78-360e-43fe-96f9-46e9d3c030fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:29:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:29:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:29:51 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016176.525756, 56391331-dd5f-4641-8208-72ba5cd514a4 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:29:51 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] VM Stopped (Lifecycle Event)
Aug 14 12:29:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9723312d-15f2-44c9-94fb-a08f1beeed7f None None] [instance: 56391331-dd5f-4641-8208-72ba5cd514a4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:29:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:29:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:29:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:16 user nova-compute[73012]: INFO nova.compute.manager [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Terminating instance
Aug 14 12:30:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-b7287faa-ff32-4f9b-8891-99934d193938 req-561c7f82-b35f-4aa5-a247-d81efb526c47 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-unplugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b7287faa-ff32-4f9b-8891-99934d193938 req-561c7f82-b35f-4aa5-a247-d81efb526c47 service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b7287faa-ff32-4f9b-8891-99934d193938 req-561c7f82-b35f-4aa5-a247-d81efb526c47 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-b7287faa-ff32-4f9b-8891-99934d193938 req-561c7f82-b35f-4aa5-a247-d81efb526c47 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-b7287faa-ff32-4f9b-8891-99934d193938 req-561c7f82-b35f-4aa5-a247-d81efb526c47 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-unplugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-b7287faa-ff32-4f9b-8891-99934d193938 req-561c7f82-b35f-4aa5-a247-d81efb526c47 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-unplugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Instance destroyed successfully.
Aug 14 12:30:16 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'resources' on Instance uuid f71ae265-b116-4048-8549-3bf44c6cdc9b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1013196602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1013196602',id=34,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-mla0txnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:28:29Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=f71ae265-b116-4048-8549-3bf44c6cdc9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "2249834b-3b89-4d69-a520-ac8b00707c36", "address": "fa:16:3e:e6:63:5d", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2249834b-3b", "ovs_interfaceid": "2249834b-3b89-4d69-a520-ac8b00707c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=2249834b-3b89-4d69-a520-ac8b00707c36,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2249834b-3b') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_vif [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=2249834b-3b89-4d69-a520-ac8b00707c36,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2249834b-3b') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2249834b-3b, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:30:16 user nova-compute[73012]: INFO os_vif [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=2249834b-3b89-4d69-a520-ac8b00707c36,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2249834b-3b')
Aug 14 12:30:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNjxgpLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:30:16 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e428df-85f6-4a68-a5a7-feb1d3feb98c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dcb1d6-b2b4-4c2a-9c0c-2fb3bbe2bc32]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:30:16 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:30:16 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:30:16 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:30:16 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:30:16 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:30:16 user nova-compute[73012]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 (non-flash)
Aug 14 12:30:16 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:30:16 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:30:16 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:30:16 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9af00cbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84'): ({'sdf'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Removing single pathed devices sdf {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa674d27-6a7d-4354-aafc-8ea9645359eb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa3efa2-2b99-4064-84fd-442488f1dc06]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flushing IO for device /dev/sdf {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc62a3cb-acad-4888-8adb-609bffb72917]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c926593-291f-4aa2-87d8-d5c4104fe9a9]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] SCSI volumes sdf have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:30:16 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef542c5b-18c1-4d23-84f3-c28c3c6ff8e1]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71763aa-b9b7-43c0-9ae6-c5445184ce81]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84, portal: 172.16.0.220,3260]
Aug 14 12:30:17 user nova-compute[73012]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84, portal: 172.16.0.220,3260] successful.
Aug 14 12:30:17 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7843bf23-ee40-45fe-a3d1-f1ea0450de84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[763f2b09-749a-4717-82ac-0d1c145f1e94]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] <== disconnect_volume: return (304ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:30:17 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Deleting instance files /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b_del
Aug 14 12:30:17 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Deletion of /opt/stack/data/nova/instances/f71ae265-b116-4048-8549-3bf44c6cdc9b_del complete
Aug 14 12:30:17 user nova-compute[73012]: INFO nova.compute.manager [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 12:30:17 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:30:17 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:30:17 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Took 0.51 seconds to deallocate network for instance.
Aug 14 12:30:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-24eef884-5663-4d92-82ad-706e7626fb56 req-2a33a659-45a8-4032-b567-2619d0e23c69 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:30:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-24eef884-5663-4d92-82ad-706e7626fb56 req-2a33a659-45a8-4032-b567-2619d0e23c69 service nova] Acquiring lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-24eef884-5663-4d92-82ad-706e7626fb56 req-2a33a659-45a8-4032-b567-2619d0e23c69 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-24eef884-5663-4d92-82ad-706e7626fb56 req-2a33a659-45a8-4032-b567-2619d0e23c69 service nova] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-24eef884-5663-4d92-82ad-706e7626fb56 req-2a33a659-45a8-4032-b567-2619d0e23c69 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] No waiting events found dispatching network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:30:18 user nova-compute[73012]: WARNING nova.compute.manager [req-24eef884-5663-4d92-82ad-706e7626fb56 req-2a33a659-45a8-4032-b567-2619d0e23c69 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received unexpected event network-vif-plugged-2249834b-3b89-4d69-a520-ac8b00707c36 for instance with vm_state active and task_state deleting.
Aug 14 12:30:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-24eef884-5663-4d92-82ad-706e7626fb56 req-2a33a659-45a8-4032-b567-2619d0e23c69 service nova] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Received event network-vif-deleted-2249834b-3b89-4d69-a520-ac8b00707c36 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:30:18 user nova-compute[73012]: INFO nova.compute.manager [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Took 0.76 seconds to detach 1 volumes for instance.
Aug 14 12:30:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:18 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:30:18 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:30:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:18 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Deleted allocations for instance f71ae265-b116-4048-8549-3bf44c6cdc9b
Aug 14 12:30:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e59f8dfa-cfad-401d-aa2a-b867bf726076 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "f71ae265-b116-4048-8549-3bf44c6cdc9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.898s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:30:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:30:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:30:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:30:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:30:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:29 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:30:29 user nova-compute[73012]: INFO nova.compute.claims [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Claim successful on node user
Aug 14 12:30:29 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:30:29 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:30:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:30:30 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.policy [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa2eccd1b9c54304aa336bfb3361b782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cacdb90792d24af296884a7af3d8b1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:30:30 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Creating image(s)
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "/opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "/opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "/opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk 1073741824" returned: 0 in 0.052s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Successfully created port: 0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Cannot resize image /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.objects.instance [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'migration_context' on Instance uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Ensure instance console log exists: /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:31 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016216.74006, f71ae265-b116-4048-8549-3bf44c6cdc9b => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:30:31 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] VM Stopped (Lifecycle Event)
Aug 14 12:30:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7a71bb8f-6e9b-4f36-9db6-3aa840e3ec65 None None] [instance: f71ae265-b116-4048-8549-3bf44c6cdc9b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:30:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:31 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Successfully updated port: 0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "refresh_cache-5817d794-ae29-42a2-8944-400a1733e849" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquired lock "refresh_cache-5817d794-ae29-42a2-8944-400a1733e849" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-a60fdd83-2d91-41ed-b792-10ab4b542994 req-2c8d8c6c-7c34-4da6-a79a-48d46264888e service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received event network-changed-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-a60fdd83-2d91-41ed-b792-10ab4b542994 req-2c8d8c6c-7c34-4da6-a79a-48d46264888e service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Refreshing instance network info cache due to event network-changed-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a60fdd83-2d91-41ed-b792-10ab4b542994 req-2c8d8c6c-7c34-4da6-a79a-48d46264888e service nova] Acquiring lock "refresh_cache-5817d794-ae29-42a2-8944-400a1733e849" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Updating instance_info_cache with network_info: [{"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Releasing lock "refresh_cache-5817d794-ae29-42a2-8944-400a1733e849" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Instance network_info: |[{"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a60fdd83-2d91-41ed-b792-10ab4b542994 req-2c8d8c6c-7c34-4da6-a79a-48d46264888e service nova] Acquired lock "refresh_cache-5817d794-ae29-42a2-8944-400a1733e849" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.neutron [req-a60fdd83-2d91-41ed-b792-10ab4b542994 req-2c8d8c6c-7c34-4da6-a79a-48d46264888e service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Refreshing network info cache for port 0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Start _get_guest_xml network_info=[{"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:30:32 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:30:32 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077533639',display_name='tempest-AttachVolumeTestJSON-server-2077533639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077533639',id=40,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpAUvde0SQBXFK/qLfnMV+TVOlaPxdrlnVE0T1T6Bv3nIuXMFxgCRPEfYAXlg6TwVlI7tDwSJX0ayRZaNxl0OnshT8PHRTuSGTfovyLBgHJ/O13BCuMt6zYOarPbRC1Iw==',key_name='tempest-keypair-1105974243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-mzf6zd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=5817d794-ae29-42a2-8944-400a1733e849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:46:4d,bridge_name='br-int',has_traffic_filtering=True,id=0ddb4a4c-65a4-4088-b606-ab3738f9c7e5,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ddb4a4c-65') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.objects.instance [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'pci_devices' on Instance uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:30:32 user nova-compute[73012]:   <uuid>5817d794-ae29-42a2-8944-400a1733e849</uuid>
Aug 14 12:30:32 user nova-compute[73012]:   <name>instance-00000028</name>
Aug 14 12:30:32 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:30:32 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:30:32 user nova-compute[73012]:   <metadata>
Aug 14 12:30:32 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:30:32 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:30:32 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeTestJSON-server-2077533639</nova:name>
Aug 14 12:30:32 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:30:32</nova:creationTime>
Aug 14 12:30:32 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:30:32 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:30:32 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:30:32 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:30:32 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:30:32 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:30:32 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:30:32 user nova-compute[73012]:       <nova:owner>
Aug 14 12:30:32 user nova-compute[73012]:         <nova:user uuid="aa2eccd1b9c54304aa336bfb3361b782">tempest-AttachVolumeTestJSON-236615257-project-member</nova:user>
Aug 14 12:30:32 user nova-compute[73012]:         <nova:project uuid="cacdb90792d24af296884a7af3d8b1c6">tempest-AttachVolumeTestJSON-236615257</nova:project>
Aug 14 12:30:32 user nova-compute[73012]:       </nova:owner>
Aug 14 12:30:32 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:30:32 user nova-compute[73012]:       <nova:ports>
Aug 14 12:30:32 user nova-compute[73012]:         <nova:port uuid="0ddb4a4c-65a4-4088-b606-ab3738f9c7e5">
Aug 14 12:30:32 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 12:30:32 user nova-compute[73012]:         </nova:port>
Aug 14 12:30:32 user nova-compute[73012]:       </nova:ports>
Aug 14 12:30:32 user nova-compute[73012]:     </nova:instance>
Aug 14 12:30:32 user nova-compute[73012]:   </metadata>
Aug 14 12:30:32 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:30:32 user nova-compute[73012]:     <system>
Aug 14 12:30:32 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:30:32 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:30:32 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:30:32 user nova-compute[73012]:       <entry name="serial">5817d794-ae29-42a2-8944-400a1733e849</entry>
Aug 14 12:30:32 user nova-compute[73012]:       <entry name="uuid">5817d794-ae29-42a2-8944-400a1733e849</entry>
Aug 14 12:30:32 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:30:32 user nova-compute[73012]:     </system>
Aug 14 12:30:32 user nova-compute[73012]:   </sysinfo>
Aug 14 12:30:32 user nova-compute[73012]:   <os>
Aug 14 12:30:32 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:30:32 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:30:32 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:30:32 user nova-compute[73012]:   </os>
Aug 14 12:30:32 user nova-compute[73012]:   <features>
Aug 14 12:30:32 user nova-compute[73012]:     <acpi/>
Aug 14 12:30:32 user nova-compute[73012]:     <apic/>
Aug 14 12:30:32 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:30:32 user nova-compute[73012]:   </features>
Aug 14 12:30:32 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:30:32 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:30:32 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:30:32 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:30:32 user nova-compute[73012]:   </clock>
Aug 14 12:30:32 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:30:32 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:30:32 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:30:32 user nova-compute[73012]:   </cpu>
Aug 14 12:30:32 user nova-compute[73012]:   <devices>
Aug 14 12:30:32 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:30:32 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:30:32 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk"/>
Aug 14 12:30:32 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:30:32 user nova-compute[73012]:     </disk>
Aug 14 12:30:32 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:30:32 user nova-compute[73012]:       <mac address="fa:16:3e:06:46:4d"/>
Aug 14 12:30:32 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:30:32 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:30:32 user nova-compute[73012]:       <target dev="tap0ddb4a4c-65"/>
Aug 14 12:30:32 user nova-compute[73012]:     </interface>
Aug 14 12:30:32 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:30:32 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/console.log" append="off"/>
Aug 14 12:30:32 user nova-compute[73012]:     </serial>
Aug 14 12:30:32 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:30:32 user nova-compute[73012]:     <video>
Aug 14 12:30:32 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:30:32 user nova-compute[73012]:     </video>
Aug 14 12:30:32 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:30:32 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:30:32 user nova-compute[73012]:     </rng>
Aug 14 12:30:32 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:30:32 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:30:32 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:30:32 user nova-compute[73012]:     </memballoon>
Aug 14 12:30:32 user nova-compute[73012]:   </devices>
Aug 14 12:30:32 user nova-compute[73012]: </domain>
Aug 14 12:30:32 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077533639',display_name='tempest-AttachVolumeTestJSON-server-2077533639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077533639',id=40,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpAUvde0SQBXFK/qLfnMV+TVOlaPxdrlnVE0T1T6Bv3nIuXMFxgCRPEfYAXlg6TwVlI7tDwSJX0ayRZaNxl0OnshT8PHRTuSGTfovyLBgHJ/O13BCuMt6zYOarPbRC1Iw==',key_name='tempest-keypair-1105974243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-mzf6zd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=5817d794-ae29-42a2-8944-400a1733e849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:46:4d,bridge_name='br-int',has_traffic_filtering=True,id=0ddb4a4c-65a4-4088-b606-ab3738f9c7e5,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ddb4a4c-65') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG os_vif [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:46:4d,bridge_name='br-int',has_traffic_filtering=True,id=0ddb4a4c-65a4-4088-b606-ab3738f9c7e5,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ddb4a4c-65') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ddb4a4c-65, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ddb4a4c-65, col_values=(('external_ids', {'iface-id': '0ddb4a4c-65a4-4088-b606-ab3738f9c7e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:46:4d', 'vm-uuid': '5817d794-ae29-42a2-8944-400a1733e849'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:32 user nova-compute[73012]: INFO os_vif [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:46:4d,bridge_name='br-int',has_traffic_filtering=True,id=0ddb4a4c-65a4-4088-b606-ab3738f9c7e5,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ddb4a4c-65')
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No VIF found with MAC fa:16:3e:06:46:4d, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.neutron [req-a60fdd83-2d91-41ed-b792-10ab4b542994 req-2c8d8c6c-7c34-4da6-a79a-48d46264888e service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Updated VIF entry in instance network info cache for port 0ddb4a4c-65a4-4088-b606-ab3738f9c7e5. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG nova.network.neutron [req-a60fdd83-2d91-41ed-b792-10ab4b542994 req-2c8d8c6c-7c34-4da6-a79a-48d46264888e service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Updating instance_info_cache with network_info: [{"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:30:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a60fdd83-2d91-41ed-b792-10ab4b542994 req-2c8d8c6c-7c34-4da6-a79a-48d46264888e service nova] Releasing lock "refresh_cache-5817d794-ae29-42a2-8944-400a1733e849" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:30:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-01d0205b-5c90-4e0a-89c1-9e64dd2817fd req-f00cd4fe-4b9d-4483-b41b-5ae37cf3096d service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received event network-vif-plugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:30:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-01d0205b-5c90-4e0a-89c1-9e64dd2817fd req-f00cd4fe-4b9d-4483-b41b-5ae37cf3096d service nova] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-01d0205b-5c90-4e0a-89c1-9e64dd2817fd req-f00cd4fe-4b9d-4483-b41b-5ae37cf3096d service nova] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-01d0205b-5c90-4e0a-89c1-9e64dd2817fd req-f00cd4fe-4b9d-4483-b41b-5ae37cf3096d service nova] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-01d0205b-5c90-4e0a-89c1-9e64dd2817fd req-f00cd4fe-4b9d-4483-b41b-5ae37cf3096d service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] No waiting events found dispatching network-vif-plugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:30:33 user nova-compute[73012]: WARNING nova.compute.manager [req-01d0205b-5c90-4e0a-89c1-9e64dd2817fd req-f00cd4fe-4b9d-4483-b41b-5ae37cf3096d service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received unexpected event network-vif-plugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 for instance with vm_state building and task_state spawning.
Aug 14 12:30:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016235.8524165, 5817d794-ae29-42a2-8944-400a1733e849 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:30:35 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 5817d794-ae29-42a2-8944-400a1733e849] VM Resumed (Lifecycle Event)
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:30:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Instance spawned successfully.
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:30:35 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 5817d794-ae29-42a2-8944-400a1733e849] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016235.8536801, 5817d794-ae29-42a2-8944-400a1733e849 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:30:35 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 5817d794-ae29-42a2-8944-400a1733e849] VM Started (Lifecycle Event)
Aug 14 12:30:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:30:35 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 5817d794-ae29-42a2-8944-400a1733e849] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:30:35 user nova-compute[73012]: INFO nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 14 12:30:35 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:30:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-d9a92d00-72ec-47c6-a8e6-21feac8273bd req-01df783e-3a00-44ba-836a-ce2a87b195bf service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received event network-vif-plugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:30:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d9a92d00-72ec-47c6-a8e6-21feac8273bd req-01df783e-3a00-44ba-836a-ce2a87b195bf service nova] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d9a92d00-72ec-47c6-a8e6-21feac8273bd req-01df783e-3a00-44ba-836a-ce2a87b195bf service nova] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d9a92d00-72ec-47c6-a8e6-21feac8273bd req-01df783e-3a00-44ba-836a-ce2a87b195bf service nova] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-d9a92d00-72ec-47c6-a8e6-21feac8273bd req-01df783e-3a00-44ba-836a-ce2a87b195bf service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] No waiting events found dispatching network-vif-plugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:30:36 user nova-compute[73012]: WARNING nova.compute.manager [req-d9a92d00-72ec-47c6-a8e6-21feac8273bd req-01df783e-3a00-44ba-836a-ce2a87b195bf service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received unexpected event network-vif-plugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 for instance with vm_state building and task_state spawning.
Aug 14 12:30:36 user nova-compute[73012]: INFO nova.compute.manager [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Took 6.48 seconds to build instance.
Aug 14 12:30:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4596977a-d73c-441c-929d-5547ff307058 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.567s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:44 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:30:46 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:30:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:30:47 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:30:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:30:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:30:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json" returned: 0 in 0.365s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:30:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:30:50 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:30:50 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=7750MB free_disk=25.15776824951172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 272f2eb9-ebeb-4246-a5a3-2a2078baebfc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 57bcdf17-1aee-4623-91f0-4376be5bad3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e8c8b03a-918a-4388-9563-389c8ec679dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance e71333db-30d2-42b9-9de3-316fc5ac7df1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 5817d794-ae29-42a2-8944-400a1733e849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:30:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:51 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:30:51 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:30:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:30:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:30:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:30:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:30:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:30:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:30:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:30:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:30:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:30:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:30:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:30:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:30:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-53dc6fd8-047e-4696-8e78-a37bd4be67c9 req-01c79188-e42a-4f9e-ba08-63cd44b66cbd service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-changed-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:30:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-53dc6fd8-047e-4696-8e78-a37bd4be67c9 req-01c79188-e42a-4f9e-ba08-63cd44b66cbd service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Refreshing instance network info cache due to event network-changed-29ec9f44-ed38-45b5-bafe-41aff2453e83. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:30:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-53dc6fd8-047e-4696-8e78-a37bd4be67c9 req-01c79188-e42a-4f9e-ba08-63cd44b66cbd service nova] Acquiring lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:30:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-53dc6fd8-047e-4696-8e78-a37bd4be67c9 req-01c79188-e42a-4f9e-ba08-63cd44b66cbd service nova] Acquired lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:30:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-53dc6fd8-047e-4696-8e78-a37bd4be67c9 req-01c79188-e42a-4f9e-ba08-63cd44b66cbd service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Refreshing network info cache for port 29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:30:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-53dc6fd8-047e-4696-8e78-a37bd4be67c9 req-01c79188-e42a-4f9e-ba08-63cd44b66cbd service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updated VIF entry in instance network info cache for port 29ec9f44-ed38-45b5-bafe-41aff2453e83. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:30:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-53dc6fd8-047e-4696-8e78-a37bd4be67c9 req-01c79188-e42a-4f9e-ba08-63cd44b66cbd service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:30:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-53dc6fd8-047e-4696-8e78-a37bd4be67c9 req-01c79188-e42a-4f9e-ba08-63cd44b66cbd service nova] Releasing lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:31:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-1bed9f3b-78d6-4b72-9804-a52be4568b70 req-c1e58bd8-259b-4ef8-b2f3-1c5da767a538 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received event network-changed-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-1bed9f3b-78d6-4b72-9804-a52be4568b70 req-c1e58bd8-259b-4ef8-b2f3-1c5da767a538 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Refreshing instance network info cache due to event network-changed-376174ee-afd0-41c7-95b5-9e7e31612cba. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:31:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1bed9f3b-78d6-4b72-9804-a52be4568b70 req-c1e58bd8-259b-4ef8-b2f3-1c5da767a538 service nova] Acquiring lock "refresh_cache-e8c8b03a-918a-4388-9563-389c8ec679dc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:31:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1bed9f3b-78d6-4b72-9804-a52be4568b70 req-c1e58bd8-259b-4ef8-b2f3-1c5da767a538 service nova] Acquired lock "refresh_cache-e8c8b03a-918a-4388-9563-389c8ec679dc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:31:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-1bed9f3b-78d6-4b72-9804-a52be4568b70 req-c1e58bd8-259b-4ef8-b2f3-1c5da767a538 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Refreshing network info cache for port 376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:31:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-1bed9f3b-78d6-4b72-9804-a52be4568b70 req-c1e58bd8-259b-4ef8-b2f3-1c5da767a538 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Updated VIF entry in instance network info cache for port 376174ee-afd0-41c7-95b5-9e7e31612cba. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:31:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-1bed9f3b-78d6-4b72-9804-a52be4568b70 req-c1e58bd8-259b-4ef8-b2f3-1c5da767a538 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Updating instance_info_cache with network_info: [{"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:31:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1bed9f3b-78d6-4b72-9804-a52be4568b70 req-c1e58bd8-259b-4ef8-b2f3-1c5da767a538 service nova] Releasing lock "refresh_cache-e8c8b03a-918a-4388-9563-389c8ec679dc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "e8c8b03a-918a-4388-9563-389c8ec679dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:06 user nova-compute[73012]: INFO nova.compute.manager [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Terminating instance
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-ab49e3ee-47cc-4371-9763-8113d84f3ce9 req-4bb89477-9423-43be-bbef-bd9d1c9e2429 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received event network-vif-unplugged-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ab49e3ee-47cc-4371-9763-8113d84f3ce9 req-4bb89477-9423-43be-bbef-bd9d1c9e2429 service nova] Acquiring lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ab49e3ee-47cc-4371-9763-8113d84f3ce9 req-4bb89477-9423-43be-bbef-bd9d1c9e2429 service nova] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ab49e3ee-47cc-4371-9763-8113d84f3ce9 req-4bb89477-9423-43be-bbef-bd9d1c9e2429 service nova] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-ab49e3ee-47cc-4371-9763-8113d84f3ce9 req-4bb89477-9423-43be-bbef-bd9d1c9e2429 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] No waiting events found dispatching network-vif-unplugged-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.compute.manager [req-ab49e3ee-47cc-4371-9763-8113d84f3ce9 req-4bb89477-9423-43be-bbef-bd9d1c9e2429 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received event network-vif-unplugged-376174ee-afd0-41c7-95b5-9e7e31612cba for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:06 user nova-compute[73012]: INFO nova.compute.manager [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Terminating instance
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:31:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Instance destroyed successfully.
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.objects.instance [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'resources' on Instance uuid e8c8b03a-918a-4388-9563-389c8ec679dc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1877325043',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1877325043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1877325043',id=38,image_ref='b71fb6a1-d26e-4cab-bad3-2b4327aef548',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7ceiDXPj8sltpvc7QYJJ1VIrKfUlcsPkzb1gutDu+qyLgHFgfemRO0zKajFgOTwiLKqOac74f2+fTRC8LtJ9SBR1/EkugyzSkuiOAo72L+UY8+q2dXpfcifit7+Ykx6w==',key_name='tempest-keypair-2092734238',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:29:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-aq5v47ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1572075418',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:29:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0311f0fd37f143739604c409233537fa',uuid=e8c8b03a-918a-4388-9563-389c8ec679dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "376174ee-afd0-41c7-95b5-9e7e31612cba", "address": "fa:16:3e:f1:14:a0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376174ee-af", "ovs_interfaceid": "376174ee-afd0-41c7-95b5-9e7e31612cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:14:a0,bridge_name='br-int',has_traffic_filtering=True,id=376174ee-afd0-41c7-95b5-9e7e31612cba,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376174ee-af') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG os_vif [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:14:a0,bridge_name='br-int',has_traffic_filtering=True,id=376174ee-afd0-41c7-95b5-9e7e31612cba,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376174ee-af') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap376174ee-af, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:06 user nova-compute[73012]: INFO os_vif [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:14:a0,bridge_name='br-int',has_traffic_filtering=True,id=376174ee-afd0-41c7-95b5-9e7e31612cba,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376174ee-af')
Aug 14 12:31:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwHVMZsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:31:06 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:31:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a8e445-7c2e-4795-bb8d-206be143562b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2511cba-4b8d-4669-bf94-889c079d38cc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:31:06 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:31:06 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:31:06 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:31:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:31:06 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:31:06 user nova-compute[73012]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 (non-flash)
Aug 14 12:31:06 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:31:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9af016d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e1980f-10e2-4869-bf7c-317717ad06c4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.040s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd015f9e-6406-48aa-94f1-0ae6fc847f26]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b374d5dc-d459-4256-83b5-432031b27da5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2c156d-8676-4d93-af3d-76f8c8189b2e]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6826299-7c9b05fe5a09490b', '/dev/disk/by-id/scsi-23763396230356665', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6826299') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb78931-ee35-4347-9893-44885510fa11]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9368eae-8584-4722-a723-0527bd945b95]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5603ae-5f5c-45bd-b2f5-bc0e78ca1387]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119, portal: 172.16.0.220,3260]
Aug 14 12:31:07 user nova-compute[73012]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119, portal: 172.16.0.220,3260] successful.
Aug 14 12:31:07 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9ab1d0-0f6c-47ae-a5d6-acb537351119 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[96445f11-ccbe-451c-9580-da9a0f072431]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== disconnect_volume: return (399ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:31:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Deleting instance files /opt/stack/data/nova/instances/e8c8b03a-918a-4388-9563-389c8ec679dc_del
Aug 14 12:31:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Deletion of /opt/stack/data/nova/instances/e8c8b03a-918a-4388-9563-389c8ec679dc_del complete
Aug 14 12:31:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Instance destroyed successfully.
Aug 14 12:31:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'resources' on Instance uuid bf1c2e78-360e-43fe-96f9-46e9d3c030fc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:31:07 user nova-compute[73012]: INFO nova.compute.manager [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1524203305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1524203305',id=31,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:21:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-t229mka4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:23:41Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=bf1c2e78-360e-43fe-96f9-46e9d3c030fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "eb488e19-4d9e-4538-976a-6e578c0edac4", "address": "fa:16:3e:63:ad:b3", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488e19-4d", "ovs_interfaceid": "eb488e19-4d9e-4538-976a-6e578c0edac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:ad:b3,bridge_name='br-int',has_traffic_filtering=True,id=eb488e19-4d9e-4538-976a-6e578c0edac4,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb488e19-4d') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG os_vif [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:ad:b3,bridge_name='br-int',has_traffic_filtering=True,id=eb488e19-4d9e-4538-976a-6e578c0edac4,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb488e19-4d') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb488e19-4d, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:07 user nova-compute[73012]: INFO os_vif [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:ad:b3,bridge_name='br-int',has_traffic_filtering=True,id=eb488e19-4d9e-4538-976a-6e578c0edac4,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb488e19-4d')
Aug 14 12:31:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Deleting instance files /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc_del
Aug 14 12:31:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Deletion of /opt/stack/data/nova/instances/bf1c2e78-360e-43fe-96f9-46e9d3c030fc_del complete
Aug 14 12:31:07 user nova-compute[73012]: INFO nova.compute.manager [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 14 12:31:07 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:31:07 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received event network-vif-plugged-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] Acquiring lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] No waiting events found dispatching network-vif-plugged-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:08 user nova-compute[73012]: WARNING nova.compute.manager [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received unexpected event network-vif-plugged-376174ee-afd0-41c7-95b5-9e7e31612cba for instance with vm_state active and task_state deleting.
Aug 14 12:31:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received event network-vif-unplugged-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] Acquiring lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] No waiting events found dispatching network-vif-unplugged-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received event network-vif-unplugged-eb488e19-4d9e-4538-976a-6e578c0edac4 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received event network-vif-plugged-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] Acquiring lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:08 user nova-compute[73012]: DEBUG nova.compute.manager [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] No waiting events found dispatching network-vif-plugged-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:08 user nova-compute[73012]: WARNING nova.compute.manager [req-7a45b7f3-7e48-466f-bee7-f73b6dbad21c req-0389f87d-6955-4f44-b56f-3c704701d7e5 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received unexpected event network-vif-plugged-eb488e19-4d9e-4538-976a-6e578c0edac4 for instance with vm_state active and task_state deleting.
Aug 14 12:31:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-f32bebbb-d9ac-4d96-9679-5a853083a542 req-312b233f-2a28-44d0-8fc7-4df31f23c5c1 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Received event network-vif-deleted-eb488e19-4d9e-4538-976a-6e578c0edac4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:09 user nova-compute[73012]: INFO nova.compute.manager [req-f32bebbb-d9ac-4d96-9679-5a853083a542 req-312b233f-2a28-44d0-8fc7-4df31f23c5c1 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Neutron deleted interface eb488e19-4d9e-4538-976a-6e578c0edac4; detaching it from the instance and deleting it from the info cache
Aug 14 12:31:09 user nova-compute[73012]: DEBUG nova.network.neutron [req-f32bebbb-d9ac-4d96-9679-5a853083a542 req-312b233f-2a28-44d0-8fc7-4df31f23c5c1 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:31:09 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:31:09 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Took 1.61 seconds to deallocate network for instance.
Aug 14 12:31:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-f32bebbb-d9ac-4d96-9679-5a853083a542 req-312b233f-2a28-44d0-8fc7-4df31f23c5c1 service nova] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Detach interface failed, port_id=eb488e19-4d9e-4538-976a-6e578c0edac4, reason: Instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:31:09 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:31:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:09 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Took 1.80 seconds to deallocate network for instance.
Aug 14 12:31:09 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:31:09 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:31:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:09 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Deleted allocations for instance bf1c2e78-360e-43fe-96f9-46e9d3c030fc
Aug 14 12:31:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7745fd30-05c1-43d1-a19c-70d60b316ce3 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "bf1c2e78-360e-43fe-96f9-46e9d3c030fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.839s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:09 user nova-compute[73012]: INFO nova.compute.manager [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Took 0.77 seconds to detach 1 volumes for instance.
Aug 14 12:31:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Deleting volume: 4c9ab1d0-0f6c-47ae-a5d6-acb537351119 {{(pid=73012) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 12:31:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:10 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:31:10 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:31:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:10 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Deleted allocations for instance e8c8b03a-918a-4388-9563-389c8ec679dc
Aug 14 12:31:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0f556e13-61c6-49c9-90d5-02a6149a5eb8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "e8c8b03a-918a-4388-9563-389c8ec679dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.441s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-d6214bad-7153-4235-b824-00bafb8b714f req-43fbb6f8-8eba-499d-8f15-98951a2f3e5c service nova] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Received event network-vif-deleted-376174ee-afd0-41c7-95b5-9e7e31612cba {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:21 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016266.7869432, e8c8b03a-918a-4388-9563-389c8ec679dc => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:31:21 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] VM Stopped (Lifecycle Event)
Aug 14 12:31:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b7fab811-f51a-4b0e-a8f8-8c9a973b7a69 None None] [instance: e8c8b03a-918a-4388-9563-389c8ec679dc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:31:22 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016267.3431513, bf1c2e78-360e-43fe-96f9-46e9d3c030fc => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:31:22 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] VM Stopped (Lifecycle Event)
Aug 14 12:31:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3c972ca0-8c1b-41eb-a649-b115d11d0ab1 None None] [instance: bf1c2e78-360e-43fe-96f9-46e9d3c030fc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:31:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-853d750a-6417-4fa6-abeb-8e6260167ff9 req-a5c3abbf-0b22-4889-b443-e6b28b2377f3 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received event network-changed-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-853d750a-6417-4fa6-abeb-8e6260167ff9 req-a5c3abbf-0b22-4889-b443-e6b28b2377f3 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Refreshing instance network info cache due to event network-changed-683204d8-ec01-4012-b79c-853959649a30. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:31:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-853d750a-6417-4fa6-abeb-8e6260167ff9 req-a5c3abbf-0b22-4889-b443-e6b28b2377f3 service nova] Acquiring lock "refresh_cache-e71333db-30d2-42b9-9de3-316fc5ac7df1" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:31:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-853d750a-6417-4fa6-abeb-8e6260167ff9 req-a5c3abbf-0b22-4889-b443-e6b28b2377f3 service nova] Acquired lock "refresh_cache-e71333db-30d2-42b9-9de3-316fc5ac7df1" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:31:32 user nova-compute[73012]: DEBUG nova.network.neutron [req-853d750a-6417-4fa6-abeb-8e6260167ff9 req-a5c3abbf-0b22-4889-b443-e6b28b2377f3 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Refreshing network info cache for port 683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "e71333db-30d2-42b9-9de3-316fc5ac7df1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:33 user nova-compute[73012]: INFO nova.compute.manager [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Terminating instance
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.network.neutron [req-853d750a-6417-4fa6-abeb-8e6260167ff9 req-a5c3abbf-0b22-4889-b443-e6b28b2377f3 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Updated VIF entry in instance network info cache for port 683204d8-ec01-4012-b79c-853959649a30. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.network.neutron [req-853d750a-6417-4fa6-abeb-8e6260167ff9 req-a5c3abbf-0b22-4889-b443-e6b28b2377f3 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Updating instance_info_cache with network_info: [{"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-853d750a-6417-4fa6-abeb-8e6260167ff9 req-a5c3abbf-0b22-4889-b443-e6b28b2377f3 service nova] Releasing lock "refresh_cache-e71333db-30d2-42b9-9de3-316fc5ac7df1" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-8785cccd-4749-46a1-a49c-2721843591ec req-6024d44a-6fe4-4b43-98f1-b60b8a154961 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received event network-vif-unplugged-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8785cccd-4749-46a1-a49c-2721843591ec req-6024d44a-6fe4-4b43-98f1-b60b8a154961 service nova] Acquiring lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8785cccd-4749-46a1-a49c-2721843591ec req-6024d44a-6fe4-4b43-98f1-b60b8a154961 service nova] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8785cccd-4749-46a1-a49c-2721843591ec req-6024d44a-6fe4-4b43-98f1-b60b8a154961 service nova] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-8785cccd-4749-46a1-a49c-2721843591ec req-6024d44a-6fe4-4b43-98f1-b60b8a154961 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] No waiting events found dispatching network-vif-unplugged-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-8785cccd-4749-46a1-a49c-2721843591ec req-6024d44a-6fe4-4b43-98f1-b60b8a154961 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received event network-vif-unplugged-683204d8-ec01-4012-b79c-853959649a30 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Instance destroyed successfully.
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.objects.instance [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'resources' on Instance uuid e71333db-30d2-42b9-9de3-316fc5ac7df1 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-640538091',display_name='tempest-AttachVolumeNegativeTest-server-640538091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-640538091',id=39,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5nzqe2yZwArxhzxvTtIECUg+A38+be5BAzqKLJRCi/WC39hZkzcrmxtErIBc+uvo4qOoNuTbBsR1JcLJA4kGCB3lhvO5/ibpzy4cIPwSJbr3IEihxrcU5sBdgEiaRtLQ==',key_name='tempest-keypair-1647037820',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-i8h3yvio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=e71333db-30d2-42b9-9de3-316fc5ac7df1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "683204d8-ec01-4012-b79c-853959649a30", "address": "fa:16:3e:cf:e7:68", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap683204d8-ec", "ovs_interfaceid": "683204d8-ec01-4012-b79c-853959649a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=683204d8-ec01-4012-b79c-853959649a30,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap683204d8-ec') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG os_vif [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=683204d8-ec01-4012-b79c-853959649a30,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap683204d8-ec') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap683204d8-ec, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:31:33 user nova-compute[73012]: INFO os_vif [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=683204d8-ec01-4012-b79c-853959649a30,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap683204d8-ec')
Aug 14 12:31:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Deleting instance files /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1_del
Aug 14 12:31:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Deletion of /opt/stack/data/nova/instances/e71333db-30d2-42b9-9de3-316fc5ac7df1_del complete
Aug 14 12:31:34 user nova-compute[73012]: INFO nova.compute.manager [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 14 12:31:34 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:31:34 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:31:34 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:31:34 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:31:34 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Took 0.86 seconds to deallocate network for instance.
Aug 14 12:31:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-48fcb178-4c41-42dd-ba8e-33f8dd940f79 req-9f63ddcd-a211-45ba-bafe-7ab8024d5dbe service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received event network-vif-deleted-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:35 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:31:35 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:31:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:35 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Deleted allocations for instance e71333db-30d2-42b9-9de3-316fc5ac7df1
Aug 14 12:31:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-39a8c875-342a-424c-a6d6-7e3a8f8e47de tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.041s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-fe7319f3-e727-4b2f-b2a3-04dca201d05a req-c2159c7b-e5eb-4872-8b9f-2ccb12caccb6 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received event network-vif-plugged-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fe7319f3-e727-4b2f-b2a3-04dca201d05a req-c2159c7b-e5eb-4872-8b9f-2ccb12caccb6 service nova] Acquiring lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fe7319f3-e727-4b2f-b2a3-04dca201d05a req-c2159c7b-e5eb-4872-8b9f-2ccb12caccb6 service nova] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fe7319f3-e727-4b2f-b2a3-04dca201d05a req-c2159c7b-e5eb-4872-8b9f-2ccb12caccb6 service nova] Lock "e71333db-30d2-42b9-9de3-316fc5ac7df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-fe7319f3-e727-4b2f-b2a3-04dca201d05a req-c2159c7b-e5eb-4872-8b9f-2ccb12caccb6 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] No waiting events found dispatching network-vif-plugged-683204d8-ec01-4012-b79c-853959649a30 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:35 user nova-compute[73012]: WARNING nova.compute.manager [req-fe7319f3-e727-4b2f-b2a3-04dca201d05a req-c2159c7b-e5eb-4872-8b9f-2ccb12caccb6 service nova] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Received unexpected event network-vif-plugged-683204d8-ec01-4012-b79c-853959649a30 for instance with vm_state deleted and task_state None.
Aug 14 12:31:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:31:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:47 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:47 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:31:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016293.8654654, e71333db-30d2-42b9-9de3-316fc5ac7df1 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:31:48 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] VM Stopped (Lifecycle Event)
Aug 14 12:31:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ec52a131-1a03-4122-9a84-6ef882853f37 None None] [instance: e71333db-30d2-42b9-9de3-316fc5ac7df1] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:31:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:31:49 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:31:49 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:31:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8209MB free_disk=25.281845092773438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:31:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 85d8779d-a30a-46ea-b979-860584678597 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f831e0c-5249-461a-a00a-484c59da5a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 272f2eb9-ebeb-4246-a5a3-2a2078baebfc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 57bcdf17-1aee-4623-91f0-4376be5bad3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 5817d794-ae29-42a2-8944-400a1733e849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:31:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 85d8779d-a30a-46ea-b979-860584678597 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updating instance_info_cache with network_info: [{"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-85d8779d-a30a-46ea-b979-860584678597" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:31:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:31:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:57 user nova-compute[73012]: INFO nova.compute.manager [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Terminating instance
Aug 14 12:31:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-603b1b8d-ab30-4473-98d4-deaf120042e9 req-c16b06bd-36f3-43e1-9386-783618fb0553 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-603b1b8d-ab30-4473-98d4-deaf120042e9 req-c16b06bd-36f3-43e1-9386-783618fb0553 service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-603b1b8d-ab30-4473-98d4-deaf120042e9 req-c16b06bd-36f3-43e1-9386-783618fb0553 service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-603b1b8d-ab30-4473-98d4-deaf120042e9 req-c16b06bd-36f3-43e1-9386-783618fb0553 service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-603b1b8d-ab30-4473-98d4-deaf120042e9 req-c16b06bd-36f3-43e1-9386-783618fb0553 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG nova.compute.manager [req-603b1b8d-ab30-4473-98d4-deaf120042e9 req-c16b06bd-36f3-43e1-9386-783618fb0553 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Instance destroyed successfully.
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'resources' on Instance uuid 4f831e0c-5249-461a-a00a-484c59da5a8a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-50514846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-50514846',id=26,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:18:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-9j75e963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:19:57Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=4f831e0c-5249-461a-a00a-484c59da5a8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "address": "fa:16:3e:47:51:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1955c5d-ee", "ovs_interfaceid": "f1955c5d-ee34-4117-b651-daa2cc4b5002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:51:79,bridge_name='br-int',has_traffic_filtering=True,id=f1955c5d-ee34-4117-b651-daa2cc4b5002,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1955c5d-ee') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG os_vif [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:51:79,bridge_name='br-int',has_traffic_filtering=True,id=f1955c5d-ee34-4117-b651-daa2cc4b5002,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1955c5d-ee') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1955c5d-ee, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:31:57 user nova-compute[73012]: INFO os_vif [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:51:79,bridge_name='br-int',has_traffic_filtering=True,id=f1955c5d-ee34-4117-b651-daa2cc4b5002,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1955c5d-ee')
Aug 14 12:31:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxtUdajk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:31:57 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:31:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d4735c-a655-4d98-ac5a-9b03e6846a3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32ea067-7e4a-453d-99d3-5595de31ba13]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:31:57 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:31:57 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:31:57 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 (non-flash)
Aug 14 12:31:57 user nova-compute[73012]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:31:57 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:31:57 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad05c7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:31:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9344ee92-5b72-4353-a3e3-0cc65de06796]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8cda5d-ee6a-450b-a4a4-fd3b2ed7b9ce]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6bfa57-e0d1-4ed4-8a26-8ba2276f69aa]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d50b275-3010-459b-a46d-f7ec7613ca26]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3bc61-2b89-4bec-8229-62bc72dc1daa]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ebc4e0-3e14-48d4-b99c-81a6318a04e3]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9, portal: 172.16.0.220,3260]
Aug 14 12:31:58 user nova-compute[73012]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9, portal: 172.16.0.220,3260] successful.
Aug 14 12:31:58 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3829322-cb1f-40f1-8ba0-8ab60eb116e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[206ff298-c8a6-4f2b-a9ac-075059fa2822]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] <== disconnect_volume: return (298ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:31:58 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Deleting instance files /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a_del
Aug 14 12:31:58 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Deletion of /opt/stack/data/nova/instances/4f831e0c-5249-461a-a00a-484c59da5a8a_del complete
Aug 14 12:31:58 user nova-compute[73012]: INFO nova.compute.manager [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 14 12:31:58 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:31:58 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:31:58 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Took 0.59 seconds to deallocate network for instance.
Aug 14 12:31:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-c9aa209d-960f-4c51-a8d3-b40c4a7642c4 req-a704f882-ee61-4b2b-ba37-0e573f8b7cd9 service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-deleted-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:59 user nova-compute[73012]: WARNING nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state active and task_state deleting.
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:59 user nova-compute[73012]: WARNING nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state active and task_state deleting.
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:59 user nova-compute[73012]: WARNING nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state active and task_state deleting.
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-unplugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Acquiring lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:31:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] No waiting events found dispatching network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:31:59 user nova-compute[73012]: WARNING nova.compute.manager [req-0be07b9c-27f6-49ea-8fea-b03a03e209d2 req-20e25f81-7ebb-49ab-b291-5123f0bbde6c service nova] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Received unexpected event network-vif-plugged-f1955c5d-ee34-4117-b651-daa2cc4b5002 for instance with vm_state active and task_state deleting.
Aug 14 12:32:01 user nova-compute[73012]: INFO nova.compute.manager [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Took 2.61 seconds to detach 1 volumes for instance.
Aug 14 12:32:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:01 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Deleted allocations for instance 4f831e0c-5249-461a-a00a-484c59da5a8a
Aug 14 12:32:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:01 user nova-compute[73012]: INFO nova.compute.manager [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Terminating instance
Aug 14 12:32:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3963e726-0f8e-4026-95c7-2a5b67a41ac9 tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "4f831e0c-5249-461a-a00a-484c59da5a8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.566s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-ae9e00a1-cb79-41b7-8356-9551da79fa8f req-348b07ce-fe75-4b68-98b1-c80c2ede92f1 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received event network-vif-unplugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ae9e00a1-cb79-41b7-8356-9551da79fa8f req-348b07ce-fe75-4b68-98b1-c80c2ede92f1 service nova] Acquiring lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ae9e00a1-cb79-41b7-8356-9551da79fa8f req-348b07ce-fe75-4b68-98b1-c80c2ede92f1 service nova] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ae9e00a1-cb79-41b7-8356-9551da79fa8f req-348b07ce-fe75-4b68-98b1-c80c2ede92f1 service nova] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-ae9e00a1-cb79-41b7-8356-9551da79fa8f req-348b07ce-fe75-4b68-98b1-c80c2ede92f1 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] No waiting events found dispatching network-vif-unplugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-ae9e00a1-cb79-41b7-8356-9551da79fa8f req-348b07ce-fe75-4b68-98b1-c80c2ede92f1 service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received event network-vif-unplugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Instance destroyed successfully.
Aug 14 12:32:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'resources' on Instance uuid 272f2eb9-ebeb-4246-a5a3-2a2078baebfc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:27:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-150243063',display_name='tempest-TestVolumeBootPattern-volume-backed-server-150243063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-150243063',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMheTN4hgwGLkfPk/pEvdKqWt3WbgudDCVi4/rhS0CMIy+mYb+dcrXe/KeapazQLDALjXLF6+idZDbDzVKLl5wzZZcdMi5FdnqyRqO4UZP+ZrruprAx2HFQwSKXESRhUEA==',key_name='tempest-keypair-1008075225',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:27:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-lbfjnoqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:27:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0311f0fd37f143739604c409233537fa',uuid=272f2eb9-ebeb-4246-a5a3-2a2078baebfc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "address": "fa:16:3e:e1:36:30", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb4b3e5-1c", "ovs_interfaceid": "2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:36:30,bridge_name='br-int',has_traffic_filtering=True,id=2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb4b3e5-1c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_vif [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:36:30,bridge_name='br-int',has_traffic_filtering=True,id=2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb4b3e5-1c') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cb4b3e5-1c, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:32:02 user nova-compute[73012]: INFO os_vif [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:36:30,bridge_name='br-int',has_traffic_filtering=True,id=2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb4b3e5-1c')
Aug 14 12:32:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjemrWdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:02 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcba873-3673-4620-9a7f-0fb02b11ef35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[04883f9a-651a-47c5-8191-b3cd3c03936a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:32:02 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:02 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 (non-flash)
Aug 14 12:32:02 user nova-compute[73012]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:02 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aacf00ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cbe852-f181-4f4f-9f91-e0432202953c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd12ed-2e9b-4b8d-87ce-975bf2c60cce]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fd4157-9e8d-494a-8d8e-622c658b77ca]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e42e6f-87b8-429f-ac1c-c23ee9a43b4b]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26236303266306564', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_30ad3e3d', '/dev/disk/by-id/scsi-1SCST_BIO30ad3e3d-b602f0ed3b31a466') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c86f796-fd2f-42fa-a518-13fbc49eb31d]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bda6123-8e2a-410b-b693-c152cf2895f7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a115ef2-4fde-4e2c-952e-98f802c9fe73]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01, portal: 172.16.0.220,3260]
Aug 14 12:32:02 user nova-compute[73012]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01, portal: 172.16.0.220,3260] successful.
Aug 14 12:32:02 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e7f68f7-cfda-452f-98ce-8889efc67b01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[06253200-4532-4636-bc2c-3d2fb00ec6ea]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== disconnect_volume: return (276ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:32:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Deleting instance files /opt/stack/data/nova/instances/272f2eb9-ebeb-4246-a5a3-2a2078baebfc_del
Aug 14 12:32:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Deletion of /opt/stack/data/nova/instances/272f2eb9-ebeb-4246-a5a3-2a2078baebfc_del complete
Aug 14 12:32:03 user nova-compute[73012]: INFO nova.compute.manager [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 14 12:32:03 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:32:03 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:32:03 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:32:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:32:03 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:32:03 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Took 1.00 seconds to deallocate network for instance.
Aug 14 12:32:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c383109-4e3f-4d0d-80a2-88358d3d416d req-bfa4e6e5-ca72-4905-abcf-6dd9c9c98d0d service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received event network-vif-plugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c383109-4e3f-4d0d-80a2-88358d3d416d req-bfa4e6e5-ca72-4905-abcf-6dd9c9c98d0d service nova] Acquiring lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c383109-4e3f-4d0d-80a2-88358d3d416d req-bfa4e6e5-ca72-4905-abcf-6dd9c9c98d0d service nova] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7c383109-4e3f-4d0d-80a2-88358d3d416d req-bfa4e6e5-ca72-4905-abcf-6dd9c9c98d0d service nova] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c383109-4e3f-4d0d-80a2-88358d3d416d req-bfa4e6e5-ca72-4905-abcf-6dd9c9c98d0d service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] No waiting events found dispatching network-vif-plugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:04 user nova-compute[73012]: WARNING nova.compute.manager [req-7c383109-4e3f-4d0d-80a2-88358d3d416d req-bfa4e6e5-ca72-4905-abcf-6dd9c9c98d0d service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received unexpected event network-vif-plugged-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 for instance with vm_state active and task_state deleting.
Aug 14 12:32:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-7c383109-4e3f-4d0d-80a2-88358d3d416d req-bfa4e6e5-ca72-4905-abcf-6dd9c9c98d0d service nova] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Received event network-vif-deleted-2cb4b3e5-1c1c-4f22-8ea6-7dc067f0cb97 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:05 user nova-compute[73012]: INFO nova.compute.manager [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Took 1.06 seconds to detach 1 volumes for instance.
Aug 14 12:32:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Deleting volume: 9e7f68f7-cfda-452f-98ce-8889efc67b01 {{(pid=73012) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:05 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Deleted allocations for instance 272f2eb9-ebeb-4246-a5a3-2a2078baebfc
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6081d199-586e-46fb-ba7e-95d856f6f107 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "272f2eb9-ebeb-4246-a5a3-2a2078baebfc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.651s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG nova.objects.instance [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'flavor' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:05 user nova-compute[73012]: INFO nova.compute.manager [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Attaching volume 46290eca-8586-4527-bf66-4d04f8176136 to /dev/vdb
Aug 14 12:32:05 user nova-compute[73012]: DEBUG os_brick.utils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[64372ccb-1acc-46da-b24a-1af68eec7f3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5055b47-d0bb-4ae4-af79-27c73ad3f9af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb73317-f85d-4051-967e-5d5cbc28a248]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e6bb9a-e59d-4c0c-9736-6f79391c0f5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:32:06 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:32:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d695f7ad-c134-4efd-bb30-9ba90c63cfe4]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG os_brick.utils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:06 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating existing volume attachment record: d37a3a0e-55ad-456b-ba7a-33543db51235 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:32:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:12 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016317.8705585, 4f831e0c-5249-461a-a00a-484c59da5a8a => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:32:12 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] VM Stopped (Lifecycle Event)
Aug 14 12:32:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1a8d1b50-5a68-4526-a078-963d29286175 None None] [instance: 4f831e0c-5249-461a-a00a-484c59da5a8a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:32:17 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016322.6312973, 272f2eb9-ebeb-4246-a5a3-2a2078baebfc => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:32:17 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] VM Stopped (Lifecycle Event)
Aug 14 12:32:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-5d3a1c73-be84-497c-9ecd-2cb9ec1d9586 None None] [instance: 272f2eb9-ebeb-4246-a5a3-2a2078baebfc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:32:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:18 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:18 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:18 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e555516-bcd6-4985-a471-592ab31c3871]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:32:18 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba9a05-a117-48d6-8170-e6167d6c4ef5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136] added
Aug 14 12:32:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e23a918-9267-4920-b826-fef05116d903]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[68390304-eaaf-4f2c-b733-d9c90fa51f5d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEkDudnI {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEkDudnI" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91afd31-88b6-4829-a21e-83ded8be2714]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gEkDudnI'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[81707d65-c03e-43a5-ad77-c79ac02b39ac]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b263279-4a4e-4877-bb85-3ca812abb672]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d389cf-9769-4f28-8be1-42076d9ddc67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]
Aug 14 12:32:18 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.
Aug 14 12:32:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8896c6f-c62d-467d-a090-cf353192d96a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f641b6c-b820-458b-b6c7-62ce47aa9fcd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:18 user nova-compute[73012]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:18 user nova-compute[73012]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f084dc-852a-4e33-a8b8-4eecffa316ec]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:18 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:32:19 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:32:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:32:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23566323835396135', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323835396135', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:32:19 user nova-compute[73012]: DEBUG nova.objects.instance [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'flavor' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:32:19 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:19 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:32:19 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:32:19 user nova-compute[73012]:   <serial>46290eca-8586-4527-bf66-4d04f8176136</serial>
Aug 14 12:32:19 user nova-compute[73012]: </disk>
Aug 14 12:32:19 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] No VIF found with MAC fa:16:3e:88:d7:00, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-64ad7012-868a-4e15-95e6-d260380b20d6 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.511s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-28994b9c-bb4e-4236-83a0-74c03add7a1f req-f9936ac6-51f4-44a8-b1ad-1dfc42509aa4 service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received event network-changed-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-28994b9c-bb4e-4236-83a0-74c03add7a1f req-f9936ac6-51f4-44a8-b1ad-1dfc42509aa4 service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Refreshing instance network info cache due to event network-changed-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-28994b9c-bb4e-4236-83a0-74c03add7a1f req-f9936ac6-51f4-44a8-b1ad-1dfc42509aa4 service nova] Acquiring lock "refresh_cache-5817d794-ae29-42a2-8944-400a1733e849" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-28994b9c-bb4e-4236-83a0-74c03add7a1f req-f9936ac6-51f4-44a8-b1ad-1dfc42509aa4 service nova] Acquired lock "refresh_cache-5817d794-ae29-42a2-8944-400a1733e849" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG nova.network.neutron [req-28994b9c-bb4e-4236-83a0-74c03add7a1f req-f9936ac6-51f4-44a8-b1ad-1dfc42509aa4 service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Refreshing network info cache for port 0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:32:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:21 user nova-compute[73012]: DEBUG nova.network.neutron [req-28994b9c-bb4e-4236-83a0-74c03add7a1f req-f9936ac6-51f4-44a8-b1ad-1dfc42509aa4 service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Updated VIF entry in instance network info cache for port 0ddb4a4c-65a4-4088-b606-ab3738f9c7e5. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:32:21 user nova-compute[73012]: DEBUG nova.network.neutron [req-28994b9c-bb4e-4236-83a0-74c03add7a1f req-f9936ac6-51f4-44a8-b1ad-1dfc42509aa4 service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Updating instance_info_cache with network_info: [{"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:32:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-28994b9c-bb4e-4236-83a0-74c03add7a1f req-f9936ac6-51f4-44a8-b1ad-1dfc42509aa4 service nova] Releasing lock "refresh_cache-5817d794-ae29-42a2-8944-400a1733e849" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:32:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Stashing vm_state: active {{(pid=73012) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 12:32:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:22 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'pci_requests' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:22 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:32:22 user nova-compute[73012]: INFO nova.compute.claims [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Claim successful on node user
Aug 14 12:32:22 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'resources' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:22 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:22 user nova-compute[73012]: INFO nova.compute.resource_tracker [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating resource usage from migration 38730336-22a5-4178-b0fb-b091558051f9
Aug 14 12:32:23 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.295s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:23 user nova-compute[73012]: INFO nova.compute.manager [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Migrating
Aug 14 12:32:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquired lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Releasing lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Starting migrate_disk_and_power_off {{(pid=73012) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG nova.objects.instance [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:24 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance destroyed successfully.
Aug 14 12:32:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-683919669',display_name='tempest-ServerActionsTestOtherB-server-683919669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-683919669',id=37,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVjrJiYPu6VYHnut5LdA0Riwd5ahrXlC4jKtuzbgu4gaPK7GwJ6AlbseM7ClHweAl3Etw8IhYAGZR1UXBZkzmwzGLDvStrigStIDDCoqd0aV5jAHV9FbuiI+5NM0Xr4Q==',key_name='tempest-keypair-284235109',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a071f634fe4f46aaab5408abc931ac4b',ramdisk_id='',reservation_id='r-70vm0iqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539296427',owner_user_name='tempest-ServerActionsTestOtherB-539296427-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:32:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84931e0fc1e64b1fb176f88e0a5fffb9',uuid=6c72a6b0-188c-486a-b6c8-4f2c0d2ae371,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-788792913-network", "vif_mac": "fa:16:3e:88:d7:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converting VIF {"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-788792913-network", "vif_mac": "fa:16:3e:88:d7:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_vif [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29ec9f44-ed, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:24 user nova-compute[73012]: INFO os_vif [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed')
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:24 user nova-compute[73012]: INFO nova.compute.manager [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Attaching volume 52c84849-60ff-41ea-8654-cc359516eeb2 to /dev/vdb
Aug 14 12:32:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:24 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcca450-cbec-403d-b246-a6cf003ec527]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2d9acd-561b-42ba-bfba-c9e26465ecd2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:24 user nova-compute[73012]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:24 user nova-compute[73012]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad013f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.utils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b778cc50-99da-40b5-b7ee-993cac0791c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b303b48c-ce0d-4297-937e-5c69b054f346]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a193c490-7c98-4309-889c-6a1001fc3177]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7231dc4-656b-4d8e-b7a7-57641b2dc010]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-44357280-f50d-40b1-a5a7-d38e0d047487 req-63557ad3-3cf5-4145-a8a8-078d211c1c83 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-44357280-f50d-40b1-a5a7-d38e0d047487 req-63557ad3-3cf5-4145-a8a8-078d211c1c83 service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-44357280-f50d-40b1-a5a7-d38e0d047487 req-63557ad3-3cf5-4145-a8a8-078d211c1c83 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-44357280-f50d-40b1-a5a7-d38e0d047487 req-63557ad3-3cf5-4145-a8a8-078d211c1c83 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-44357280-f50d-40b1-a5a7-d38e0d047487 req-63557ad3-3cf5-4145-a8a8-078d211c1c83 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:24 user nova-compute[73012]: WARNING nova.compute.manager [req-44357280-f50d-40b1-a5a7-d38e0d047487 req-63557ad3-3cf5-4145-a8a8-078d211c1c83 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state resize_migrating.
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd302267-ad6b-417d-ba45-19b22e87992d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b019df38-7dbd-4931-8bb4-ea637c8e3550]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ac74f4-2718-4167-b40b-3520201a2e47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa5a096-a084-42aa-a604-9f6d2274dff4]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:32:24 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb094840-c3a8-43b6-bd83-0aa541a77397]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.utils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Updating existing volume attachment record: bc2ee405-8fc3-415e-a8cd-1379f465c724 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9109a30b-5dcf-4694-a714-5efa6c745da0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[857fe1b4-69dc-40c9-95ab-ae06ef851ddc]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]
Aug 14 12:32:24 user nova-compute[73012]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.
Aug 14 12:32:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca4df5f-eadb-480a-85c4-e550f1d732f3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] <== disconnect_volume: return (319ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371_resize/disk /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:25 user nova-compute[73012]: INFO nova.compute.manager [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Detaching volume 0296d548-8c97-480e-9bbd-f7b614f2189a
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "cp -r /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371_resize/disk /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk" returned: 0 in 0.226s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371_resize/disk.info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk.info {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "cp -r /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371_resize/disk.info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk.info" returned: 0 in 0.036s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:25 user nova-compute[73012]: INFO nova.virt.block_device [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Attempting to driver detach volume 0296d548-8c97-480e-9bbd-f7b614f2189a from mountpoint /dev/vdb
Aug 14 12:32:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Attempting to detach device vdb from instance 57bcdf17-1aee-4623-91f0-4376be5bad3a from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:32:25 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:25 user nova-compute[73012]:   <source dev="/dev/sde"/>
Aug 14 12:32:25 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:32:25 user nova-compute[73012]:   <serial>0296d548-8c97-480e-9bbd-f7b614f2189a</serial>
Aug 14 12:32:25 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:32:25 user nova-compute[73012]: </disk>
Aug 14 12:32:25 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:32:25 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully detached device vdb from instance 57bcdf17-1aee-4623-91f0-4376be5bad3a from the persistent domain config.
Aug 14 12:32:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 57bcdf17-1aee-4623-91f0-4376be5bad3a from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:32:25 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:25 user nova-compute[73012]:   <source dev="/dev/sde"/>
Aug 14 12:32:25 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:32:25 user nova-compute[73012]:   <serial>0296d548-8c97-480e-9bbd-f7b614f2189a</serial>
Aug 14 12:32:25 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:32:25 user nova-compute[73012]: </disk>
Aug 14 12:32:25 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:32:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692016346.216113, 57bcdf17-1aee-4623-91f0-4376be5bad3a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 57bcdf17-1aee-4623-91f0-4376be5bad3a {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:32:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully detached device vdb from instance 57bcdf17-1aee-4623-91f0-4376be5bad3a from the live domain config.
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJjGkPZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:26 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.089s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cad40de-8df6-4d61-b55d-98889f2e5a32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9443ae29-9f5f-4717-823c-54f2b392acfb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a (non-flash)
Aug 14 12:32:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad06c4280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a'): ({'sde'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Removing single pathed devices sde {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fc122a-2ad5-4a4f-9f77-9b6d57cd7776]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e476ce-b1d3-479e-aedc-59d2dbb8b35c]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flushing IO for device /dev/sde {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e45d9d7-1047-4213-86b4-48803a86875f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b5a912-53ab-4c4b-8fff-8e318b840c20]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] SCSI volumes sde have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e33c997-33fa-4d71-b53e-2649cf2c268e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec14e9d9-44a5-4e82-9946-c636032da3de]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a, portal: 172.16.0.220,3260]
Aug 14 12:32:26 user nova-compute[73012]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a, portal: 172.16.0.220,3260] successful.
Aug 14 12:32:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0296d548-8c97-480e-9bbd-f7b614f2189a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e27bed-8fd0-4790-b83d-9551f4230688]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] <== disconnect_volume: return (354ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:26 user nova-compute[73012]: WARNING nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state resize_migrating.
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:26 user nova-compute[73012]: WARNING nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state resize_migrating.
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:26 user nova-compute[73012]: WARNING nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state resize_migrating.
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:26 user nova-compute[73012]: WARNING nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state resize_migrating.
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:26 user nova-compute[73012]: DEBUG nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:26 user nova-compute[73012]: WARNING nova.compute.manager [req-f5135f01-6437-43fe-b803-114f0774acc8 req-94cef02d-77aa-4427-8aaa-d8587b3968bf service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state resize_migrating.
Aug 14 12:32:27 user nova-compute[73012]: DEBUG nova.objects.instance [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'flavor' on Instance uuid 57bcdf17-1aee-4623-91f0-4376be5bad3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c05bb7a-62ea-4c87-a50b-cf4ec02d0f16 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.869s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Port 29ec9f44-ed38-45b5-bafe-41aff2453e83 binding to destination host user is already ACTIVE {{(pid=73012) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yARjlpUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:33 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:33 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:33 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f8dcc5-020e-4f9a-8e48-dad8def40669]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:32:33 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b69234c-6fb9-4a86-a5c0-c1ba04ac777e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2] added
Aug 14 12:32:33 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06b8eb1-91cc-46ff-9ffd-8900e8a31a6a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af95cfc-830a-419a-84e0-ca1ebad59aa8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:33 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yARjlpUc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquired lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yARjlpUc" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dac511-8cd8-4f84-88a8-7c76ae3d4ddd]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yARjlpUc'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[914cc8ec-18ff-48d9-9bb2-fe5ee6dbd992]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef410803-d977-453f-b85d-430990b0f4d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:32:34 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:32:34 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:32:34 user nova-compute[73012]: 
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[775344ad-3e52-4c92-a080-30defcae7e9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2, portal: 172.16.0.220,3260]
Aug 14 12:32:34 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2, portal: 172.16.0.220,3260] successful.
Aug 14 12:32:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[31146638-50f7-48fb-a9e2-61c39e838a80]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51f20bb-3fdb-4371-91e2-a71941075b16]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b6e2e-a75b-4f78-809a-bd6430938ce2]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yARjlpUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Releasing lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.utils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadb0e58-697b-4c3b-801d-6056b7edf06e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[470659fe-9f32-4a59-a322-7987fb04f79a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef333bd8-a62a-4b9a-ade0-a78927ab2ad1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b23040-2587-43ce-af81-ff422bc318f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:32:34 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:32:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[87abd9a3-f6e0-4e20-86e2-ae9b41c05701]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:32:34 user nova-compute[73012]: DEBUG os_brick.utils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23432666364363434', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432666364363434', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG nova.objects.instance [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:32:35 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:35 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:32:35 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:32:35 user nova-compute[73012]:   <serial>52c84849-60ff-41ea-8654-cc359516eeb2</serial>
Aug 14 12:32:35 user nova-compute[73012]: </disk>
Aug 14 12:32:35 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No VIF found with MAC fa:16:3e:06:46:4d, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-224dee46-b305-46c4-88fa-2da194f8c046 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.060s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 85d8779d-a30a-46ea-b979-860584678597 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 57bcdf17-1aee-4623-91f0-4376be5bad3a {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "85d8779d-a30a-46ea-b979-860584678597" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "85d8779d-a30a-46ea-b979-860584678597" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:36 user nova-compute[73012]: INFO nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "5817d794-ae29-42a2-8944-400a1733e849" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "85d8779d-a30a-46ea-b979-860584678597" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "5817d794-ae29-42a2-8944-400a1733e849" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:39 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016344.6082258, 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:32:39 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] VM Stopped (Lifecycle Event)
Aug 14 12:32:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cb9b862d-7e3e-4331-8ff6-ee5e54aa3c4d None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:32:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cb9b862d-7e3e-4331-8ff6-ee5e54aa3c4d None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:32:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:39 user nova-compute[73012]: INFO nova.compute.manager [None req-cb9b862d-7e3e-4331-8ff6-ee5e54aa3c4d None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 12:32:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:40 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:41 user nova-compute[73012]: INFO nova.compute.manager [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Attaching volume c1e8d019-af34-49bb-aa99-02a7cdbbaf8f to /dev/vdc
Aug 14 12:32:41 user nova-compute[73012]: DEBUG os_brick.utils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d99dee2-e8eb-46fd-871d-96aa86dee14b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90fd0c3-2a77-45b0-84f4-ab1df6a8dbd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e82a550-e146-4d80-9fa8-389e6953899f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a0193-e0c5-4512-9369-0dcf5005cae3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:32:41 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:32:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3ccb88-215d-449c-b978-f8461012282e]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG os_brick.utils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:41 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Updating existing volume attachment record: 87377b59-c96c-4529-b413-6cfddffc8043 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:32:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:32:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Starting finish_migration {{(pid=73012) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 12:32:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance directory exists: not creating {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 12:32:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Creating image(s)
Aug 14 12:32:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:45 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:45 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk. size=21474836480 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:32:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk 21474836480 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk 21474836480" returned: 0 in 0.063s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Ensure instance console log exists: /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Start _get_guest_xml network_info=[{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-788792913-network", "vif_mac": "fa:16:3e:88:d7:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6c72a6b0-188c-486a-b6c8-4f2c0d2ae371', 'attached_at': '2023-08-14T12:32:45.000000', 'detached_at': '', 'volume_id': '46290eca-8586-4527-bf66-4d04f8176136', 'serial': '46290eca-8586-4527-bf66-4d04f8176136'}, 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '49201210-a9ad-4f10-b4ca-e1fe7b5984b8', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:32:46 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:32:46 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:46 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:46 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:46 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efae101-de3e-4806-920e-d757f5407b2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:32:46 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7917641c-d07a-429f-9deb-72778a204b59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136] added
Aug 14 12:32:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[30918686-e4ea-4b6b-816c-8552da2487c2]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb23397-5992-47f0-9de5-3f2ba3f09102]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEkDudnI {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEkDudnI" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a653a609-db33-4f44-a96e-afbab3f6c8bb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gEkDudnI'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac74155-5ff3-41cf-bfa6-eb77bc296beb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29c4e11-3789-4238-ac80-41344a0c7f24]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab15995-5c8c-4ca8-b6e6-fac31d6debe3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]
Aug 14 12:32:46 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.
Aug 14 12:32:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f34eea-4ccc-44fa-a40a-b3c86544aa32]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e5bf5c-d1fe-4ce0-a1e8-0aba0120573a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:46 user nova-compute[73012]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:46 user nova-compute[73012]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee08497-1d02-45d0-8f4b-a7941b39c3d4]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23566323835396135', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323835396135', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-683919669',display_name='tempest-ServerActionsTestOtherB-server-683919669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-683919669',id=37,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVjrJiYPu6VYHnut5LdA0Riwd5ahrXlC4jKtuzbgu4gaPK7GwJ6AlbseM7ClHweAl3Etw8IhYAGZR1UXBZkzmwzGLDvStrigStIDDCoqd0aV5jAHV9FbuiI+5NM0Xr4Q==',key_name='tempest-keypair-284235109',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a071f634fe4f46aaab5408abc931ac4b',ramdisk_id='',reservation_id='r-70vm0iqa',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539296427',owner_user_name='tempest-ServerActionsTestOtherB-539296427-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84931e0fc1e64b1fb176f88e0a5fffb9',uuid=6c72a6b0-188c-486a-b6c8-4f2c0d2ae371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-788792913-network", "vif_mac": "fa:16:3e:88:d7:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converting VIF {"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-788792913-network", "vif_mac": "fa:16:3e:88:d7:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:32:47 user nova-compute[73012]:   <uuid>6c72a6b0-188c-486a-b6c8-4f2c0d2ae371</uuid>
Aug 14 12:32:47 user nova-compute[73012]:   <name>instance-00000025</name>
Aug 14 12:32:47 user nova-compute[73012]:   <memory>2097152</memory>
Aug 14 12:32:47 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:32:47 user nova-compute[73012]:   <metadata>
Aug 14 12:32:47 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:32:47 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:32:47 user nova-compute[73012]:       <nova:name>tempest-ServerActionsTestOtherB-server-683919669</nova:name>
Aug 14 12:32:47 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:32:46</nova:creationTime>
Aug 14 12:32:47 user nova-compute[73012]:       <nova:flavor name="m1.small">
Aug 14 12:32:47 user nova-compute[73012]:         <nova:memory>2048</nova:memory>
Aug 14 12:32:47 user nova-compute[73012]:         <nova:disk>20</nova:disk>
Aug 14 12:32:47 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:32:47 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:32:47 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:32:47 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:32:47 user nova-compute[73012]:       <nova:owner>
Aug 14 12:32:47 user nova-compute[73012]:         <nova:user uuid="84931e0fc1e64b1fb176f88e0a5fffb9">tempest-ServerActionsTestOtherB-539296427-project-member</nova:user>
Aug 14 12:32:47 user nova-compute[73012]:         <nova:project uuid="a071f634fe4f46aaab5408abc931ac4b">tempest-ServerActionsTestOtherB-539296427</nova:project>
Aug 14 12:32:47 user nova-compute[73012]:       </nova:owner>
Aug 14 12:32:47 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:32:47 user nova-compute[73012]:       <nova:ports>
Aug 14 12:32:47 user nova-compute[73012]:         <nova:port uuid="29ec9f44-ed38-45b5-bafe-41aff2453e83">
Aug 14 12:32:47 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:32:47 user nova-compute[73012]:         </nova:port>
Aug 14 12:32:47 user nova-compute[73012]:       </nova:ports>
Aug 14 12:32:47 user nova-compute[73012]:     </nova:instance>
Aug 14 12:32:47 user nova-compute[73012]:   </metadata>
Aug 14 12:32:47 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:32:47 user nova-compute[73012]:     <system>
Aug 14 12:32:47 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:32:47 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:32:47 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:32:47 user nova-compute[73012]:       <entry name="serial">6c72a6b0-188c-486a-b6c8-4f2c0d2ae371</entry>
Aug 14 12:32:47 user nova-compute[73012]:       <entry name="uuid">6c72a6b0-188c-486a-b6c8-4f2c0d2ae371</entry>
Aug 14 12:32:47 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:32:47 user nova-compute[73012]:     </system>
Aug 14 12:32:47 user nova-compute[73012]:   </sysinfo>
Aug 14 12:32:47 user nova-compute[73012]:   <os>
Aug 14 12:32:47 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:32:47 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:32:47 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:32:47 user nova-compute[73012]:   </os>
Aug 14 12:32:47 user nova-compute[73012]:   <features>
Aug 14 12:32:47 user nova-compute[73012]:     <acpi/>
Aug 14 12:32:47 user nova-compute[73012]:     <apic/>
Aug 14 12:32:47 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:32:47 user nova-compute[73012]:   </features>
Aug 14 12:32:47 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:32:47 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:32:47 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:32:47 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:32:47 user nova-compute[73012]:   </clock>
Aug 14 12:32:47 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:32:47 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:32:47 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:32:47 user nova-compute[73012]:   </cpu>
Aug 14 12:32:47 user nova-compute[73012]:   <devices>
Aug 14 12:32:47 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:32:47 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:32:47 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk"/>
Aug 14 12:32:47 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:32:47 user nova-compute[73012]:     </disk>
Aug 14 12:32:47 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:32:47 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:47 user nova-compute[73012]:       <source dev="/dev/sdc"/>
Aug 14 12:32:47 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:32:47 user nova-compute[73012]:       <serial>46290eca-8586-4527-bf66-4d04f8176136</serial>
Aug 14 12:32:47 user nova-compute[73012]:     </disk>
Aug 14 12:32:47 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:32:47 user nova-compute[73012]:       <mac address="fa:16:3e:88:d7:00"/>
Aug 14 12:32:47 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:32:47 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:32:47 user nova-compute[73012]:       <target dev="tap29ec9f44-ed"/>
Aug 14 12:32:47 user nova-compute[73012]:     </interface>
Aug 14 12:32:47 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:32:47 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/console.log" append="off"/>
Aug 14 12:32:47 user nova-compute[73012]:     </serial>
Aug 14 12:32:47 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:32:47 user nova-compute[73012]:     <video>
Aug 14 12:32:47 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:32:47 user nova-compute[73012]:     </video>
Aug 14 12:32:47 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:32:47 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:32:47 user nova-compute[73012]:     </rng>
Aug 14 12:32:47 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:32:47 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:32:47 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:32:47 user nova-compute[73012]:     </memballoon>
Aug 14 12:32:47 user nova-compute[73012]:   </devices>
Aug 14 12:32:47 user nova-compute[73012]: </domain>
Aug 14 12:32:47 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-683919669',display_name='tempest-ServerActionsTestOtherB-server-683919669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-683919669',id=37,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVjrJiYPu6VYHnut5LdA0Riwd5ahrXlC4jKtuzbgu4gaPK7GwJ6AlbseM7ClHweAl3Etw8IhYAGZR1UXBZkzmwzGLDvStrigStIDDCoqd0aV5jAHV9FbuiI+5NM0Xr4Q==',key_name='tempest-keypair-284235109',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a071f634fe4f46aaab5408abc931ac4b',ramdisk_id='',reservation_id='r-70vm0iqa',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539296427',owner_user_name='tempest-ServerActionsTestOtherB-539296427-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84931e0fc1e64b1fb176f88e0a5fffb9',uuid=6c72a6b0-188c-486a-b6c8-4f2c0d2ae371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-788792913-network", "vif_mac": "fa:16:3e:88:d7:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converting VIF {"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-788792913-network", "vif_mac": "fa:16:3e:88:d7:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG os_vif [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29ec9f44-ed, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29ec9f44-ed, col_values=(('external_ids', {'iface-id': '29ec9f44-ed38-45b5-bafe-41aff2453e83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:d7:00', 'vm-uuid': '6c72a6b0-188c-486a-b6c8-4f2c0d2ae371'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:47 user nova-compute[73012]: INFO os_vif [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed')
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:32:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] No VIF found with MAC fa:16:3e:88:d7:00, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "85d8779d-a30a-46ea-b979-860584678597" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "85d8779d-a30a-46ea-b979-860584678597" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "85d8779d-a30a-46ea-b979-860584678597-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "85d8779d-a30a-46ea-b979-860584678597-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "85d8779d-a30a-46ea-b979-860584678597-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:48 user nova-compute[73012]: INFO nova.compute.manager [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Terminating instance
Aug 14 12:32:48 user nova-compute[73012]: DEBUG nova.compute.manager [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-146c9a8a-5e71-47e1-8245-3917963fcbfa req-893e35eb-0759-4c10-80c7-ec31b1904c54 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received event network-vif-unplugged-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-146c9a8a-5e71-47e1-8245-3917963fcbfa req-893e35eb-0759-4c10-80c7-ec31b1904c54 service nova] Acquiring lock "85d8779d-a30a-46ea-b979-860584678597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-146c9a8a-5e71-47e1-8245-3917963fcbfa req-893e35eb-0759-4c10-80c7-ec31b1904c54 service nova] Lock "85d8779d-a30a-46ea-b979-860584678597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-146c9a8a-5e71-47e1-8245-3917963fcbfa req-893e35eb-0759-4c10-80c7-ec31b1904c54 service nova] Lock "85d8779d-a30a-46ea-b979-860584678597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-146c9a8a-5e71-47e1-8245-3917963fcbfa req-893e35eb-0759-4c10-80c7-ec31b1904c54 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] No waiting events found dispatching network-vif-unplugged-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-146c9a8a-5e71-47e1-8245-3917963fcbfa req-893e35eb-0759-4c10-80c7-ec31b1904c54 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received event network-vif-unplugged-d7f8f436-6585-4530-bb5a-e03ec969514b for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 85d8779d-a30a-46ea-b979-860584678597] Instance destroyed successfully.
Aug 14 12:32:49 user nova-compute[73012]: DEBUG nova.objects.instance [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lazy-loading 'resources' on Instance uuid 85d8779d-a30a-46ea-b979-860584678597 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:13:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1356726673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1356726673',id=23,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b1960abc96445f483386773f67d83e3',ramdisk_id='',reservation_id='r-8wiheeu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:15:07Z,user_data=None,user_id='ae1ce3345617447486642ebe88c1621c',uuid=85d8779d-a30a-46ea-b979-860584678597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converting VIF {"id": "d7f8f436-6585-4530-bb5a-e03ec969514b", "address": "fa:16:3e:89:d1:79", "network": {"id": "2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1576946847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b1960abc96445f483386773f67d83e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f8f436-65", "ovs_interfaceid": "d7f8f436-6585-4530-bb5a-e03ec969514b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:d1:79,bridge_name='br-int',has_traffic_filtering=True,id=d7f8f436-6585-4530-bb5a-e03ec969514b,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f8f436-65') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG os_vif [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:d1:79,bridge_name='br-int',has_traffic_filtering=True,id=d7f8f436-6585-4530-bb5a-e03ec969514b,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f8f436-65') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7f8f436-65, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:32:49 user nova-compute[73012]: INFO os_vif [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:d1:79,bridge_name='br-int',has_traffic_filtering=True,id=d7f8f436-6585-4530-bb5a-e03ec969514b,network=Network(2e95fe33-d0d1-40a5-bc2b-fa4e9811a04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f8f436-65')
Aug 14 12:32:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Deleting instance files /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597_del
Aug 14 12:32:49 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Deletion of /opt/stack/data/nova/instances/85d8779d-a30a-46ea-b979-860584678597_del complete
Aug 14 12:32:49 user nova-compute[73012]: INFO nova.compute.manager [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] [instance: 85d8779d-a30a-46ea-b979-860584678597] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 14 12:32:49 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 85d8779d-a30a-46ea-b979-860584678597] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 85d8779d-a30a-46ea-b979-860584678597] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnhqbZtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:49 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:49 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:49 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:49 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:32:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2ec3cb-62a8-4ad3-852f-ccda4471104e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:32:50 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc14f1a-747c-4f4d-ab92-2a153c5233a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f] added
Aug 14 12:32:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2756a76a-6856-48cf-9894-d7e66121ca03]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b35acb5-5f70-4545-b700-a677ff0574af]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnhqbZtm {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnhqbZtm" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b071ed4-6788-4fec-81ad-5f361fc1e69e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UnhqbZtm'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b6e768-d922-4b02-a2cf-ecde10bb6fd1]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db0fca9-c3ca-401b-8ed4-07e4a6ee83fc]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:50 user nova-compute[73012]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:50 user nova-compute[73012]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[99de3bc7-ea62-4e1f-95c3-ecefe0e381a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f, portal: 172.16.0.220,3260]
Aug 14 12:32:50 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f, portal: 172.16.0.220,3260] successful.
Aug 14 12:32:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.062s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b969b2ac-43bc-445d-b66a-9739d9c193b1]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 85d8779d-a30a-46ea-b979-860584678597] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ee7f74-8f58-46c5-917d-95ab29f9d2fc]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:50 user nova-compute[73012]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:50 user nova-compute[73012]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f (non-flash)
Aug 14 12:32:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:50 user nova-compute[73012]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:50 user nova-compute[73012]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f (non-flash)
Aug 14 12:32:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:32:50 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 85d8779d-a30a-46ea-b979-860584678597] Took 0.95 seconds to deallocate network for instance.
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a087feff-327a-4c57-9968-adbba5e4eb8a]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnhqbZtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received event network-vif-plugged-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] Acquiring lock "85d8779d-a30a-46ea-b979-860584678597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] Lock "85d8779d-a30a-46ea-b979-860584678597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] Lock "85d8779d-a30a-46ea-b979-860584678597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] No waiting events found dispatching network-vif-plugged-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:50 user nova-compute[73012]: WARNING nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received unexpected event network-vif-plugged-d7f8f436-6585-4530-bb5a-e03ec969514b for instance with vm_state active and task_state deleting.
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:50 user nova-compute[73012]: WARNING nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state resize_finish.
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:50 user nova-compute[73012]: WARNING nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state resize_finish.
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-c1b67c16-2b8b-48f4-9058-fe9106907200 req-7646b695-9646-4b86-a8cd-2e56e4cef3c0 service nova] [instance: 85d8779d-a30a-46ea-b979-860584678597] Received event network-vif-deleted-d7f8f436-6585-4530-bb5a-e03ec969514b {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:50 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Deleted allocations for instance 85d8779d-a30a-46ea-b979-860584678597
Aug 14 12:32:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-3353bdb2-989a-4f93-bbd9-87e18d788c7d tempest-ServerBootFromVolumeStableRescueTest-1756944789 tempest-ServerBootFromVolumeStableRescueTest-1756944789-project-member] Lock "85d8779d-a30a-46ea-b979-860584678597" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.107s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:51 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:32:51 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=25.348228454589844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Applying migration context for instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 as it has an incoming, in-progress migration 38730336-22a5-4178-b0fb-b091558051f9. Migration status is post-migrating {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 12:32:51 user nova-compute[73012]: INFO nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating resource usage from migration 38730336-22a5-4178-b0fb-b091558051f9
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016371.3818097, 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:32:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] VM Resumed (Lifecycle Event)
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:32:51 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance running successfully.
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Failed to set time: agent not configured {{(pid=73012) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ccb76a4c-a373-40e1-8e19-2c0db8fe6d81 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] finish_migration finished successfully. {{(pid=73012) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 57bcdf17-1aee-4623-91f0-4376be5bad3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 5817d794-ae29-42a2-8944-400a1733e849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Migration 38730336-22a5-4178-b0fb-b091558051f9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=23GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:32:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016371.382935, 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:32:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] VM Started (Lifecycle Event)
Aug 14 12:32:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23432303465316565', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432303465316565', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.objects.instance [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:32:51 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:51 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:32:51 user nova-compute[73012]:   <target dev="vdc" bus="virtio"/>
Aug 14 12:32:51 user nova-compute[73012]:   <serial>c1e8d019-af34-49bb-aa99-02a7cdbbaf8f</serial>
Aug 14 12:32:51 user nova-compute[73012]: </disk>
Aug 14 12:32:51 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:32:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:32:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] No VIF found with MAC fa:16:3e:06:46:4d, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:32:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-6fc2aba8-b542-4468-bad1-7a5ba8e0b1a0 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.967s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:53 user nova-compute[73012]: INFO nova.compute.manager [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Detaching volume 52c84849-60ff-41ea-8654-cc359516eeb2
Aug 14 12:32:53 user nova-compute[73012]: INFO nova.virt.block_device [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Attempting to driver detach volume 52c84849-60ff-41ea-8654-cc359516eeb2 from mountpoint /dev/vdb
Aug 14 12:32:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Attempting to detach device vdb from instance 5817d794-ae29-42a2-8944-400a1733e849 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:32:53 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:53 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:32:53 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:32:53 user nova-compute[73012]:   <serial>52c84849-60ff-41ea-8654-cc359516eeb2</serial>
Aug 14 12:32:53 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:32:53 user nova-compute[73012]: </disk>
Aug 14 12:32:53 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:32:53 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully detached device vdb from instance 5817d794-ae29-42a2-8944-400a1733e849 from the persistent domain config.
Aug 14 12:32:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5817d794-ae29-42a2-8944-400a1733e849 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:32:53 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:53 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:32:53 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:32:53 user nova-compute[73012]:   <serial>52c84849-60ff-41ea-8654-cc359516eeb2</serial>
Aug 14 12:32:53 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:32:53 user nova-compute[73012]: </disk>
Aug 14 12:32:53 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692016373.9769325, 5817d794-ae29-42a2-8944-400a1733e849 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:32:53 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully detached device vdb from instance 5817d794-ae29-42a2-8944-400a1733e849 from the live domain config.
Aug 14 12:32:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yARjlpUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:53 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:32:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a83f7bb-18c1-4915-a8c3-f6d1fd4b5d20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60c5849-3f8a-46d2-b55f-5af136009072]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:54 user nova-compute[73012]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:54 user nova-compute[73012]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f (non-flash)
Aug 14 12:32:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 (non-flash)
Aug 14 12:32:54 user nova-compute[73012]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:54 user nova-compute[73012]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f (non-flash)
Aug 14 12:32:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad014beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0317a9-3fad-4b01-8e47-3c05e7396950]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee03e4c7-3a0c-4e4c-b03c-0de807c0e899]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2502eee-14c7-4a83-a7eb-f7d184808dfd]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41dfce8-96e7-4c3d-b45c-e46e0a21b61e]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18fc37e-6084-4e00-9502-aef5614da81e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2804f4-262e-4d3e-8fca-f884b45ae572]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2, portal: 172.16.0.220,3260]
Aug 14 12:32:54 user nova-compute[73012]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2, portal: 172.16.0.220,3260] successful.
Aug 14 12:32:54 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c84849-60ff-41ea-8654-cc359516eeb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[18910e02-e21d-4467-b946-af8063694ca5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== disconnect_volume: return (300ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Updating instance_info_cache with network_info: [{"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-57bcdf17-1aee-4623-91f0-4376be5bad3a" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:32:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:55 user nova-compute[73012]: DEBUG nova.objects.instance [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-26b74532-2797-4fd9-943d-2610d54946bf tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.780s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:32:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:55 user nova-compute[73012]: INFO nova.compute.manager [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Detaching volume c1e8d019-af34-49bb-aa99-02a7cdbbaf8f
Aug 14 12:32:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:56 user nova-compute[73012]: INFO nova.virt.block_device [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Attempting to driver detach volume c1e8d019-af34-49bb-aa99-02a7cdbbaf8f from mountpoint /dev/vdc
Aug 14 12:32:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Attempting to detach device vdc from instance 5817d794-ae29-42a2-8944-400a1733e849 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:32:56 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:56 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:32:56 user nova-compute[73012]:   <target dev="vdc" bus="virtio"/>
Aug 14 12:32:56 user nova-compute[73012]:   <serial>c1e8d019-af34-49bb-aa99-02a7cdbbaf8f</serial>
Aug 14 12:32:56 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 12:32:56 user nova-compute[73012]: </disk>
Aug 14 12:32:56 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:32:56 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully detached device vdc from instance 5817d794-ae29-42a2-8944-400a1733e849 from the persistent domain config.
Aug 14 12:32:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5817d794-ae29-42a2-8944-400a1733e849 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:32:56 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:32:56 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:32:56 user nova-compute[73012]:   <target dev="vdc" bus="virtio"/>
Aug 14 12:32:56 user nova-compute[73012]:   <serial>c1e8d019-af34-49bb-aa99-02a7cdbbaf8f</serial>
Aug 14 12:32:56 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 12:32:56 user nova-compute[73012]: </disk>
Aug 14 12:32:56 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692016376.501669, 5817d794-ae29-42a2-8944-400a1733e849 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:32:56 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully detached device vdc from instance 5817d794-ae29-42a2-8944-400a1733e849 from the live domain config.
Aug 14 12:32:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnhqbZtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:32:56 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf4f294-0a56-46ef-b855-81da6fc02a84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dbe35b-25a2-4cc1-96b6-9dcc704bb024]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:56 user nova-compute[73012]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f (non-flash)
Aug 14 12:32:56 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:32:56 user nova-compute[73012]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f (non-flash)
Aug 14 12:32:56 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aacd181f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc851b2-4fb1-4b48-836a-cb54ad8c2e9a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[476be465-3b77-444f-8069-8b9c1d62d978]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4babcc-50f5-4d64-9f37-b94780591226]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b32c64f-afb1-42b3-9754-71dcce1e429d]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b525208a-0a84-4e23-934d-e5e6d35aba78]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[08902932-ebcc-451d-942a-0618858b2fac]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f, portal: 172.16.0.220,3260]
Aug 14 12:32:56 user nova-compute[73012]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f, portal: 172.16.0.220,3260] successful.
Aug 14 12:32:56 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1e8d019-af34-49bb-aa99-02a7cdbbaf8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[97709fa5-62c5-401d-9605-2d8f6b1f9127]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] <== disconnect_volume: return (274ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:32:56 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:32:57 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'flavor' on Instance uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c6f091bb-1cdf-4830-a89a-3b80a80c56ae tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.835s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:58 user nova-compute[73012]: INFO nova.compute.manager [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Terminating instance
Aug 14 12:32:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:32:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-4ad20a5c-7f45-41ad-80fe-851560c62d38 req-528838ca-a48d-4df1-b3c7-d53a25000086 service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received event network-vif-unplugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4ad20a5c-7f45-41ad-80fe-851560c62d38 req-528838ca-a48d-4df1-b3c7-d53a25000086 service nova] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4ad20a5c-7f45-41ad-80fe-851560c62d38 req-528838ca-a48d-4df1-b3c7-d53a25000086 service nova] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4ad20a5c-7f45-41ad-80fe-851560c62d38 req-528838ca-a48d-4df1-b3c7-d53a25000086 service nova] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-4ad20a5c-7f45-41ad-80fe-851560c62d38 req-528838ca-a48d-4df1-b3c7-d53a25000086 service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] No waiting events found dispatching network-vif-unplugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-4ad20a5c-7f45-41ad-80fe-851560c62d38 req-528838ca-a48d-4df1-b3c7-d53a25000086 service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received event network-vif-unplugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Instance destroyed successfully.
Aug 14 12:32:59 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lazy-loading 'resources' on Instance uuid 5817d794-ae29-42a2-8944-400a1733e849 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077533639',display_name='tempest-AttachVolumeTestJSON-server-2077533639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077533639',id=40,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpAUvde0SQBXFK/qLfnMV+TVOlaPxdrlnVE0T1T6Bv3nIuXMFxgCRPEfYAXlg6TwVlI7tDwSJX0ayRZaNxl0OnshT8PHRTuSGTfovyLBgHJ/O13BCuMt6zYOarPbRC1Iw==',key_name='tempest-keypair-1105974243',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:30:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cacdb90792d24af296884a7af3d8b1c6',ramdisk_id='',reservation_id='r-mzf6zd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236615257',owner_user_name='tempest-AttachVolumeTestJSON-236615257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa2eccd1b9c54304aa336bfb3361b782',uuid=5817d794-ae29-42a2-8944-400a1733e849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converting VIF {"id": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "address": "fa:16:3e:06:46:4d", "network": {"id": "c7672c21-d0e8-4b79-aad9-d4ad912f9b49", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-449750637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cacdb90792d24af296884a7af3d8b1c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ddb4a4c-65", "ovs_interfaceid": "0ddb4a4c-65a4-4088-b606-ab3738f9c7e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:46:4d,bridge_name='br-int',has_traffic_filtering=True,id=0ddb4a4c-65a4-4088-b606-ab3738f9c7e5,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ddb4a4c-65') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG os_vif [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:46:4d,bridge_name='br-int',has_traffic_filtering=True,id=0ddb4a4c-65a4-4088-b606-ab3738f9c7e5,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ddb4a4c-65') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ddb4a4c-65, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:32:59 user nova-compute[73012]: INFO os_vif [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:46:4d,bridge_name='br-int',has_traffic_filtering=True,id=0ddb4a4c-65a4-4088-b606-ab3738f9c7e5,network=Network(c7672c21-d0e8-4b79-aad9-d4ad912f9b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ddb4a4c-65')
Aug 14 12:32:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Deleting instance files /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849_del
Aug 14 12:32:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Deletion of /opt/stack/data/nova/instances/5817d794-ae29-42a2-8944-400a1733e849_del complete
Aug 14 12:32:59 user nova-compute[73012]: INFO nova.compute.manager [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 12:32:59 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:32:59 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 5817d794-ae29-42a2-8944-400a1733e849] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:33:00 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:33:00 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Took 1.38 seconds to deallocate network for instance.
Aug 14 12:33:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-b796261d-35ed-49f2-8ca0-82832a20f092 req-935530e1-0111-4fa5-b2b4-017bea56d964 service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received event network-vif-deleted-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:33:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:01 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:33:01 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:33:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-87b5574f-bfa9-4e02-a5c5-7fea97cb3e95 req-b7f92f65-f505-4335-a750-663cae78758f service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received event network-vif-plugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:33:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87b5574f-bfa9-4e02-a5c5-7fea97cb3e95 req-b7f92f65-f505-4335-a750-663cae78758f service nova] Acquiring lock "5817d794-ae29-42a2-8944-400a1733e849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87b5574f-bfa9-4e02-a5c5-7fea97cb3e95 req-b7f92f65-f505-4335-a750-663cae78758f service nova] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87b5574f-bfa9-4e02-a5c5-7fea97cb3e95 req-b7f92f65-f505-4335-a750-663cae78758f service nova] Lock "5817d794-ae29-42a2-8944-400a1733e849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-87b5574f-bfa9-4e02-a5c5-7fea97cb3e95 req-b7f92f65-f505-4335-a750-663cae78758f service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] No waiting events found dispatching network-vif-plugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:33:01 user nova-compute[73012]: WARNING nova.compute.manager [req-87b5574f-bfa9-4e02-a5c5-7fea97cb3e95 req-b7f92f65-f505-4335-a750-663cae78758f service nova] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Received unexpected event network-vif-plugged-0ddb4a4c-65a4-4088-b606-ab3738f9c7e5 for instance with vm_state deleted and task_state None.
Aug 14 12:33:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:01 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Deleted allocations for instance 5817d794-ae29-42a2-8944-400a1733e849
Aug 14 12:33:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dcf2957a-7b68-4e49-97dd-52f2801f7ea9 tempest-AttachVolumeTestJSON-236615257 tempest-AttachVolumeTestJSON-236615257-project-member] Lock "5817d794-ae29-42a2-8944-400a1733e849" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.685s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:04 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016369.1321003, 85d8779d-a30a-46ea-b979-860584678597 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:33:04 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 85d8779d-a30a-46ea-b979-860584678597] VM Stopped (Lifecycle Event)
Aug 14 12:33:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e2d1f4b3-d81e-448c-9dc4-e0019e40eb27 None None] [instance: 85d8779d-a30a-46ea-b979-860584678597] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:33:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:33:05 user nova-compute[73012]: INFO nova.compute.claims [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Claim successful on node user
Aug 14 12:33:05 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG nova.network.neutron [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:33:05 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:33:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:33:05 user nova-compute[73012]: INFO nova.virt.block_device [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Booting with volume 03cff6c0-a19c-4526-9143-3edac05caef2 at /dev/vda
Aug 14 12:33:05 user nova-compute[73012]: DEBUG nova.policy [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0311f0fd37f143739604c409233537fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7699b5c3fcc34a619e5d0d066e8ff642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:33:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG os_brick.utils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c249a397-3c30-4d60-843f-f4e6410dd737]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[336fca80-293a-40f1-8bc4-86788c62a9e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[649e86fb-37cf-427b-8cd1-163d5fde3c2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f08d386-d885-4418-822d-07625f16e3a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:33:06 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:33:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c27f461-7f30-4540-8774-357b892c026f]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG os_brick.utils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Updating existing volume attachment record: 487d203d-70f3-4e7a-b6ff-aac98e75247f {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:33:06 user nova-compute[73012]: DEBUG nova.network.neutron [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Successfully created port: 02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:33:07 user nova-compute[73012]: DEBUG nova.network.neutron [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Successfully updated port: 02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:33:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "refresh_cache-ae462e6f-d5d9-43a6-ae26-b4b07f89350f" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:33:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquired lock "refresh_cache-ae462e6f-d5d9-43a6-ae26-b4b07f89350f" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:33:07 user nova-compute[73012]: DEBUG nova.network.neutron [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:33:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-20730868-0b4b-438a-ab79-74495f1bd02d req-5b5e4140-3055-4fc0-b6a2-db8600b5362f service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received event network-changed-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:33:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-20730868-0b4b-438a-ab79-74495f1bd02d req-5b5e4140-3055-4fc0-b6a2-db8600b5362f service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Refreshing instance network info cache due to event network-changed-02bf32e8-44ad-47f3-aea2-6f9607471c5d. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:33:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-20730868-0b4b-438a-ab79-74495f1bd02d req-5b5e4140-3055-4fc0-b6a2-db8600b5362f service nova] Acquiring lock "refresh_cache-ae462e6f-d5d9-43a6-ae26-b4b07f89350f" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:33:07 user nova-compute[73012]: DEBUG nova.network.neutron [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:33:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Updating instance_info_cache with network_info: [{"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:33:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Releasing lock "refresh_cache-ae462e6f-d5d9-43a6-ae26-b4b07f89350f" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:33:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Instance network_info: |[{"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:33:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-20730868-0b4b-438a-ab79-74495f1bd02d req-5b5e4140-3055-4fc0-b6a2-db8600b5362f service nova] Acquired lock "refresh_cache-ae462e6f-d5d9-43a6-ae26-b4b07f89350f" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:33:08 user nova-compute[73012]: DEBUG nova.network.neutron [req-20730868-0b4b-438a-ab79-74495f1bd02d req-5b5e4140-3055-4fc0-b6a2-db8600b5362f service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Refreshing network info cache for port 02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:33:09 user nova-compute[73012]: DEBUG nova.network.neutron [req-20730868-0b4b-438a-ab79-74495f1bd02d req-5b5e4140-3055-4fc0-b6a2-db8600b5362f service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Updated VIF entry in instance network info cache for port 02bf32e8-44ad-47f3-aea2-6f9607471c5d. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:33:09 user nova-compute[73012]: DEBUG nova.network.neutron [req-20730868-0b4b-438a-ab79-74495f1bd02d req-5b5e4140-3055-4fc0-b6a2-db8600b5362f service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Updating instance_info_cache with network_info: [{"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:33:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-20730868-0b4b-438a-ab79-74495f1bd02d req-5b5e4140-3055-4fc0-b6a2-db8600b5362f service nova] Releasing lock "refresh_cache-ae462e6f-d5d9-43a6-ae26-b4b07f89350f" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:33:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016379.3405616, 5817d794-ae29-42a2-8944-400a1733e849 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:33:14 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 5817d794-ae29-42a2-8944-400a1733e849] VM Stopped (Lifecycle Event)
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-64ba5312-4f42-404c-9833-cbb9a2135e00 None None] [instance: 5817d794-ae29-42a2-8944-400a1733e849] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:33:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Creating image(s)
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Ensure instance console log exists: /opt/stack/data/nova/instances/ae462e6f-d5d9-43a6-ae26-b4b07f89350f/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Start _get_guest_xml network_info=[{"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyeaRgFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae462e6f-d5d9-43a6-ae26-b4b07f89350f', 'attached_at': '', 'detached_at': '', 'volume_id': '03cff6c0-a19c-4526-9143-3edac05caef2', 'serial': '03cff6c0-a19c-4526-9143-3edac05caef2'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '487d203d-70f3-4e7a-b6ff-aac98e75247f', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:33:14 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:33:14 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyeaRgFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:33:14 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:33:14 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:33:14 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[caee1533-9724-422a-bfa0-daf91ccd7ba7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:33:14 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafc28d4-8a56-4ab2-af30-3fbead419e98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2] added
Aug 14 12:33:14 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf6d6ab-bacb-4868-9a1f-91703d858762]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b21c942-9092-4f54-8480-210001cc9480]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyeaRgFY {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyeaRgFY" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e1e893-7eef-458c-bb36-2732d2d9b2a4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QyeaRgFY'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b3b779-b4df-473f-bc22-3590ee72ce8f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a736b6-f9d1-4312-ad06-3bf04580a76d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:33:14 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:33:14 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34a9352-d71b-411f-b953-ef6771c2a4ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260]
Aug 14 12:33:14 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260] successful.
Aug 14 12:33:14 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[88426169-2f15-42d1-b2ed-4881b566b7a4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb0249e-d5e7-4138-b476-f5d9ad2851e8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:33:14 user nova-compute[73012]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:33:14 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:33:14 user nova-compute[73012]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:33:14 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2ff0b2-d7fd-4544-a919-a21aefde459f]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:33:14 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyeaRgFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23132363736383832', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132363736383832', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-773287673',display_name='tempest-TestVolumeBootPattern-server-773287673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-773287673',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg7lN4gu0O9CJgDpyBhy0RX3jSYGXDmrd1kKjcONe+vy3hXe0gfOqavEjgU06+fs+8PvDAL8t8WC3udIvRk5S68ldJhrYI9gy8tZpcPsibRZmE5rDqMVaBs/gzMf1AsPA==',key_name='tempest-TestVolumeBootPattern-1852675789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-0side43x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:33:06Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=ae462e6f-d5d9-43a6-ae26-b4b07f89350f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:35,bridge_name='br-int',has_traffic_filtering=True,id=02bf32e8-44ad-47f3-aea2-6f9607471c5d,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bf32e8-44') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG nova.objects.instance [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'pci_devices' on Instance uuid ae462e6f-d5d9-43a6-ae26-b4b07f89350f {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:33:15 user nova-compute[73012]:   <uuid>ae462e6f-d5d9-43a6-ae26-b4b07f89350f</uuid>
Aug 14 12:33:15 user nova-compute[73012]:   <name>instance-00000029</name>
Aug 14 12:33:15 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:33:15 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:33:15 user nova-compute[73012]:   <metadata>
Aug 14 12:33:15 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:33:15 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:33:15 user nova-compute[73012]:       <nova:name>tempest-TestVolumeBootPattern-server-773287673</nova:name>
Aug 14 12:33:15 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:33:14</nova:creationTime>
Aug 14 12:33:15 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:33:15 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:33:15 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:33:15 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:33:15 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:33:15 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:33:15 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:33:15 user nova-compute[73012]:       <nova:owner>
Aug 14 12:33:15 user nova-compute[73012]:         <nova:user uuid="0311f0fd37f143739604c409233537fa">tempest-TestVolumeBootPattern-1572075418-project-member</nova:user>
Aug 14 12:33:15 user nova-compute[73012]:         <nova:project uuid="7699b5c3fcc34a619e5d0d066e8ff642">tempest-TestVolumeBootPattern-1572075418</nova:project>
Aug 14 12:33:15 user nova-compute[73012]:       </nova:owner>
Aug 14 12:33:15 user nova-compute[73012]:       <nova:ports>
Aug 14 12:33:15 user nova-compute[73012]:         <nova:port uuid="02bf32e8-44ad-47f3-aea2-6f9607471c5d">
Aug 14 12:33:15 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 12:33:15 user nova-compute[73012]:         </nova:port>
Aug 14 12:33:15 user nova-compute[73012]:       </nova:ports>
Aug 14 12:33:15 user nova-compute[73012]:     </nova:instance>
Aug 14 12:33:15 user nova-compute[73012]:   </metadata>
Aug 14 12:33:15 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:33:15 user nova-compute[73012]:     <system>
Aug 14 12:33:15 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:33:15 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:33:15 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:33:15 user nova-compute[73012]:       <entry name="serial">ae462e6f-d5d9-43a6-ae26-b4b07f89350f</entry>
Aug 14 12:33:15 user nova-compute[73012]:       <entry name="uuid">ae462e6f-d5d9-43a6-ae26-b4b07f89350f</entry>
Aug 14 12:33:15 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:33:15 user nova-compute[73012]:     </system>
Aug 14 12:33:15 user nova-compute[73012]:   </sysinfo>
Aug 14 12:33:15 user nova-compute[73012]:   <os>
Aug 14 12:33:15 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:33:15 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:33:15 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:33:15 user nova-compute[73012]:   </os>
Aug 14 12:33:15 user nova-compute[73012]:   <features>
Aug 14 12:33:15 user nova-compute[73012]:     <acpi/>
Aug 14 12:33:15 user nova-compute[73012]:     <apic/>
Aug 14 12:33:15 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:33:15 user nova-compute[73012]:   </features>
Aug 14 12:33:15 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:33:15 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:33:15 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:33:15 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:33:15 user nova-compute[73012]:   </clock>
Aug 14 12:33:15 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:33:15 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:33:15 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:33:15 user nova-compute[73012]:   </cpu>
Aug 14 12:33:15 user nova-compute[73012]:   <devices>
Aug 14 12:33:15 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:33:15 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:33:15 user nova-compute[73012]:       <source dev="/dev/sdb"/>
Aug 14 12:33:15 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:33:15 user nova-compute[73012]:       <serial>03cff6c0-a19c-4526-9143-3edac05caef2</serial>
Aug 14 12:33:15 user nova-compute[73012]:     </disk>
Aug 14 12:33:15 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:33:15 user nova-compute[73012]:       <mac address="fa:16:3e:5f:37:35"/>
Aug 14 12:33:15 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:33:15 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:33:15 user nova-compute[73012]:       <target dev="tap02bf32e8-44"/>
Aug 14 12:33:15 user nova-compute[73012]:     </interface>
Aug 14 12:33:15 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:33:15 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/ae462e6f-d5d9-43a6-ae26-b4b07f89350f/console.log" append="off"/>
Aug 14 12:33:15 user nova-compute[73012]:     </serial>
Aug 14 12:33:15 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:33:15 user nova-compute[73012]:     <video>
Aug 14 12:33:15 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:33:15 user nova-compute[73012]:     </video>
Aug 14 12:33:15 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:33:15 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:33:15 user nova-compute[73012]:     </rng>
Aug 14 12:33:15 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:33:15 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:33:15 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:33:15 user nova-compute[73012]:     </memballoon>
Aug 14 12:33:15 user nova-compute[73012]:   </devices>
Aug 14 12:33:15 user nova-compute[73012]: </domain>
Aug 14 12:33:15 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-773287673',display_name='tempest-TestVolumeBootPattern-server-773287673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-773287673',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg7lN4gu0O9CJgDpyBhy0RX3jSYGXDmrd1kKjcONe+vy3hXe0gfOqavEjgU06+fs+8PvDAL8t8WC3udIvRk5S68ldJhrYI9gy8tZpcPsibRZmE5rDqMVaBs/gzMf1AsPA==',key_name='tempest-TestVolumeBootPattern-1852675789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-0side43x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:33:06Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=ae462e6f-d5d9-43a6-ae26-b4b07f89350f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:35,bridge_name='br-int',has_traffic_filtering=True,id=02bf32e8-44ad-47f3-aea2-6f9607471c5d,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bf32e8-44') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG os_vif [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:35,bridge_name='br-int',has_traffic_filtering=True,id=02bf32e8-44ad-47f3-aea2-6f9607471c5d,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bf32e8-44') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02bf32e8-44, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02bf32e8-44, col_values=(('external_ids', {'iface-id': '02bf32e8-44ad-47f3-aea2-6f9607471c5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:37:35', 'vm-uuid': 'ae462e6f-d5d9-43a6-ae26-b4b07f89350f'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:15 user nova-compute[73012]: INFO os_vif [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:35,bridge_name='br-int',has_traffic_filtering=True,id=02bf32e8-44ad-47f3-aea2-6f9607471c5d,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bf32e8-44')
Aug 14 12:33:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No VIF found with MAC fa:16:3e:5f:37:35, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:16 user nova-compute[73012]: INFO nova.compute.manager [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Terminating instance
Aug 14 12:33:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-eff7033c-4bb0-4c4f-b6ec-c97974fe4392 req-6eeea134-4fb8-4463-b543-c58ed823121c service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received event network-vif-unplugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-eff7033c-4bb0-4c4f-b6ec-c97974fe4392 req-6eeea134-4fb8-4463-b543-c58ed823121c service nova] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-eff7033c-4bb0-4c4f-b6ec-c97974fe4392 req-6eeea134-4fb8-4463-b543-c58ed823121c service nova] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-eff7033c-4bb0-4c4f-b6ec-c97974fe4392 req-6eeea134-4fb8-4463-b543-c58ed823121c service nova] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-eff7033c-4bb0-4c4f-b6ec-c97974fe4392 req-6eeea134-4fb8-4463-b543-c58ed823121c service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] No waiting events found dispatching network-vif-unplugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:33:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-eff7033c-4bb0-4c4f-b6ec-c97974fe4392 req-6eeea134-4fb8-4463-b543-c58ed823121c service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received event network-vif-unplugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:33:17 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Instance destroyed successfully.
Aug 14 12:33:17 user nova-compute[73012]: DEBUG nova.objects.instance [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'resources' on Instance uuid 57bcdf17-1aee-4623-91f0-4376be5bad3a {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:27:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1577890376',display_name='tempest-AttachVolumeNegativeTest-server-1577890376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1577890376',id=36,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOI2k4vTFB1D75peFfi5leVt/b7/mm5rBMi74Ot6PXaVP6PKMa6TQ+qIC/wCxRkR2JtPOo/Ogh1cuE+gaNT0hzueK+NFwQ9ym1lG5mio9MEXwh/0IEtwxhvaEnUcKLpQ+g==',key_name='tempest-keypair-375130110',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-6kbbefl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:27:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=57bcdf17-1aee-4623-91f0-4376be5bad3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "address": "fa:16:3e:15:2e:71", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442347ea-cc", "ovs_interfaceid": "442347ea-cc5d-4d3f-ac9f-8d87fb735f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=442347ea-cc5d-4d3f-ac9f-8d87fb735f8a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442347ea-cc') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG os_vif [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=442347ea-cc5d-4d3f-ac9f-8d87fb735f8a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442347ea-cc') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap442347ea-cc, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:17 user nova-compute[73012]: INFO os_vif [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:2e:71,bridge_name='br-int',has_traffic_filtering=True,id=442347ea-cc5d-4d3f-ac9f-8d87fb735f8a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442347ea-cc')
Aug 14 12:33:17 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Deleting instance files /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a_del
Aug 14 12:33:17 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Deletion of /opt/stack/data/nova/instances/57bcdf17-1aee-4623-91f0-4376be5bad3a_del complete
Aug 14 12:33:17 user nova-compute[73012]: INFO nova.compute.manager [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 14 12:33:17 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG nova.compute.manager [req-3b7fb635-e66b-4965-865c-2873e7cc8ee6 req-a821bd64-a191-4f6b-a2ed-0b8f53eed976 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received event network-vif-plugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3b7fb635-e66b-4965-865c-2873e7cc8ee6 req-a821bd64-a191-4f6b-a2ed-0b8f53eed976 service nova] Acquiring lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3b7fb635-e66b-4965-865c-2873e7cc8ee6 req-a821bd64-a191-4f6b-a2ed-0b8f53eed976 service nova] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3b7fb635-e66b-4965-865c-2873e7cc8ee6 req-a821bd64-a191-4f6b-a2ed-0b8f53eed976 service nova] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:17 user nova-compute[73012]: DEBUG nova.compute.manager [req-3b7fb635-e66b-4965-865c-2873e7cc8ee6 req-a821bd64-a191-4f6b-a2ed-0b8f53eed976 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] No waiting events found dispatching network-vif-plugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:33:17 user nova-compute[73012]: WARNING nova.compute.manager [req-3b7fb635-e66b-4965-865c-2873e7cc8ee6 req-a821bd64-a191-4f6b-a2ed-0b8f53eed976 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received unexpected event network-vif-plugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d for instance with vm_state building and task_state spawning.
Aug 14 12:33:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:33:18 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Took 0.92 seconds to deallocate network for instance.
Aug 14 12:33:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-d6b3030e-9337-4beb-b1f9-706bf0a8e836 req-9cb6db4d-3560-4d25-84bb-b1e82350f798 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received event network-vif-deleted-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-12695664-5fce-429d-aa9c-e1e168fb1c3f req-a1c046a7-88a1-4140-95fc-00ff528d0d74 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received event network-vif-plugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12695664-5fce-429d-aa9c-e1e168fb1c3f req-a1c046a7-88a1-4140-95fc-00ff528d0d74 service nova] Acquiring lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12695664-5fce-429d-aa9c-e1e168fb1c3f req-a1c046a7-88a1-4140-95fc-00ff528d0d74 service nova] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12695664-5fce-429d-aa9c-e1e168fb1c3f req-a1c046a7-88a1-4140-95fc-00ff528d0d74 service nova] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-12695664-5fce-429d-aa9c-e1e168fb1c3f req-a1c046a7-88a1-4140-95fc-00ff528d0d74 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] No waiting events found dispatching network-vif-plugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:33:18 user nova-compute[73012]: WARNING nova.compute.manager [req-12695664-5fce-429d-aa9c-e1e168fb1c3f req-a1c046a7-88a1-4140-95fc-00ff528d0d74 service nova] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Received unexpected event network-vif-plugged-442347ea-cc5d-4d3f-ac9f-8d87fb735f8a for instance with vm_state deleted and task_state None.
Aug 14 12:33:18 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:33:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:18 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Deleted allocations for instance 57bcdf17-1aee-4623-91f0-4376be5bad3a
Aug 14 12:33:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-0a2dedac-c978-40ee-aaa1-438914b0f7dc tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "57bcdf17-1aee-4623-91f0-4376be5bad3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.588s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016399.6526568, ae462e6f-d5d9-43a6-ae26-b4b07f89350f => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:33:19 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] VM Resumed (Lifecycle Event)
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:33:19 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Instance spawned successfully.
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:33:19 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016399.6556559, ae462e6f-d5d9-43a6-ae26-b4b07f89350f => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:33:19 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] VM Started (Lifecycle Event)
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:33:19 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:33:19 user nova-compute[73012]: INFO nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:33:19 user nova-compute[73012]: INFO nova.compute.manager [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Took 14.37 seconds to build instance.
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.compute.manager [req-7607cbfe-3fab-4120-ba66-748be8d17950 req-e881ea4e-b0f4-474c-b6a0-ff3930560d41 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received event network-vif-plugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7607cbfe-3fab-4120-ba66-748be8d17950 req-e881ea4e-b0f4-474c-b6a0-ff3930560d41 service nova] Acquiring lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7607cbfe-3fab-4120-ba66-748be8d17950 req-e881ea4e-b0f4-474c-b6a0-ff3930560d41 service nova] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7607cbfe-3fab-4120-ba66-748be8d17950 req-e881ea4e-b0f4-474c-b6a0-ff3930560d41 service nova] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:19 user nova-compute[73012]: DEBUG nova.compute.manager [req-7607cbfe-3fab-4120-ba66-748be8d17950 req-e881ea4e-b0f4-474c-b6a0-ff3930560d41 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] No waiting events found dispatching network-vif-plugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:33:19 user nova-compute[73012]: WARNING nova.compute.manager [req-7607cbfe-3fab-4120-ba66-748be8d17950 req-e881ea4e-b0f4-474c-b6a0-ff3930560d41 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received unexpected event network-vif-plugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d for instance with vm_state active and task_state None.
Aug 14 12:33:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-891fbd8d-9823-4d8d-805e-56a978e137f2 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.486s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:33:32 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016397.2225373, 57bcdf17-1aee-4623-91f0-4376be5bad3a => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:33:32 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] VM Stopped (Lifecycle Event)
Aug 14 12:33:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e6537030-3cba-4173-9646-a2c5e422faa6 None None] [instance: 57bcdf17-1aee-4623-91f0-4376be5bad3a] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:33:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:33:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:33:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:33:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:33:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:47 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:33:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:33:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:33:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:33:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:33:49 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:33:49 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=25.419677734375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Applying migration context for instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 as it has an incoming, in-progress migration 38730336-22a5-4178-b0fb-b091558051f9. Migration status is finished {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 12:33:49 user nova-compute[73012]: INFO nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating resource usage from migration 38730336-22a5-4178-b0fb-b091558051f9
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Migration 38730336-22a5-4178-b0fb-b091558051f9 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ae462e6f-d5d9-43a6-ae26-b4b07f89350f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=21GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:33:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:33:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:33:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:33:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:33:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:33:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:33:51 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:33:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:52 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:33:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:33:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:33:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:33:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:33:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:33:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:33:56 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:33:56 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:33:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:33:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:33:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:33:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:33:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:33:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:34:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:34:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:34:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:09 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:34:09 user nova-compute[73012]: INFO nova.compute.claims [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Claim successful on node user
Aug 14 12:34:10 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:34:10 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:34:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:34:10 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Creating image(s)
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "/opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "/opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG nova.policy [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbc96fd6e33b4e4aae1de009a457c08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef9274d18f04a30bb977bb9ef163bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk 1073741824" returned: 0 in 0.050s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Cannot resize image /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG nova.objects.instance [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'migration_context' on Instance uuid 4f892efc-9623-4dff-b540-291c55639499 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Successfully created port: 2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Ensure instance console log exists: /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Successfully updated port: 2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquired lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-ecfa0e84-6fd5-4a09-a056-0c05416fc1ce req-60a2adf3-ceb1-4bcd-ac22-087cee2c9bb3 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received event network-changed-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-ecfa0e84-6fd5-4a09-a056-0c05416fc1ce req-60a2adf3-ceb1-4bcd-ac22-087cee2c9bb3 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Refreshing instance network info cache due to event network-changed-2a969928-5934-417f-b66e-7a61c0946c3a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecfa0e84-6fd5-4a09-a056-0c05416fc1ce req-60a2adf3-ceb1-4bcd-ac22-087cee2c9bb3 service nova] Acquiring lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Updating instance_info_cache with network_info: [{"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Port 29ec9f44-ed38-45b5-bafe-41aff2453e83 binding to destination host user is already ACTIVE {{(pid=73012) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquired lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Releasing lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Instance network_info: |[{"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecfa0e84-6fd5-4a09-a056-0c05416fc1ce req-60a2adf3-ceb1-4bcd-ac22-087cee2c9bb3 service nova] Acquired lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-ecfa0e84-6fd5-4a09-a056-0c05416fc1ce req-60a2adf3-ceb1-4bcd-ac22-087cee2c9bb3 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Refreshing network info cache for port 2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Start _get_guest_xml network_info=[{"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:34:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:34:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2026622822',display_name='tempest-AttachVolumeNegativeTest-server-2026622822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2026622822',id=42,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL187sl9LBt/6lAy2MwftUu7NVFLrlKFY9BaN6oMzXVl+F13GNqEjQxosSDf37Mpt5eA4oToLgaMVUH1X9MGdz1JALeuOBbE4S4uHi3hM5Sc13SrHJ/pJgwF3kuloTI1dw==',key_name='tempest-keypair-202284652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-kufkoug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=4f892efc-9623-4dff-b540-291c55639499,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:28:aa,bridge_name='br-int',has_traffic_filtering=True,id=2a969928-5934-417f-b66e-7a61c0946c3a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a969928-59') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f892efc-9623-4dff-b540-291c55639499 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:34:12 user nova-compute[73012]:   <uuid>4f892efc-9623-4dff-b540-291c55639499</uuid>
Aug 14 12:34:12 user nova-compute[73012]:   <name>instance-0000002a</name>
Aug 14 12:34:12 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:34:12 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:34:12 user nova-compute[73012]:   <metadata>
Aug 14 12:34:12 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:34:12 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:34:12 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2026622822</nova:name>
Aug 14 12:34:12 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:34:12</nova:creationTime>
Aug 14 12:34:12 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:34:12 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:34:12 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:34:12 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:34:12 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:34:12 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:34:12 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:34:12 user nova-compute[73012]:       <nova:owner>
Aug 14 12:34:12 user nova-compute[73012]:         <nova:user uuid="cbc96fd6e33b4e4aae1de009a457c08a">tempest-AttachVolumeNegativeTest-1684368273-project-member</nova:user>
Aug 14 12:34:12 user nova-compute[73012]:         <nova:project uuid="bef9274d18f04a30bb977bb9ef163bc5">tempest-AttachVolumeNegativeTest-1684368273</nova:project>
Aug 14 12:34:12 user nova-compute[73012]:       </nova:owner>
Aug 14 12:34:12 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:34:12 user nova-compute[73012]:       <nova:ports>
Aug 14 12:34:12 user nova-compute[73012]:         <nova:port uuid="2a969928-5934-417f-b66e-7a61c0946c3a">
Aug 14 12:34:12 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:34:12 user nova-compute[73012]:         </nova:port>
Aug 14 12:34:12 user nova-compute[73012]:       </nova:ports>
Aug 14 12:34:12 user nova-compute[73012]:     </nova:instance>
Aug 14 12:34:12 user nova-compute[73012]:   </metadata>
Aug 14 12:34:12 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:34:12 user nova-compute[73012]:     <system>
Aug 14 12:34:12 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:34:12 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:34:12 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:34:12 user nova-compute[73012]:       <entry name="serial">4f892efc-9623-4dff-b540-291c55639499</entry>
Aug 14 12:34:12 user nova-compute[73012]:       <entry name="uuid">4f892efc-9623-4dff-b540-291c55639499</entry>
Aug 14 12:34:12 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:34:12 user nova-compute[73012]:     </system>
Aug 14 12:34:12 user nova-compute[73012]:   </sysinfo>
Aug 14 12:34:12 user nova-compute[73012]:   <os>
Aug 14 12:34:12 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:34:12 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:34:12 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:34:12 user nova-compute[73012]:   </os>
Aug 14 12:34:12 user nova-compute[73012]:   <features>
Aug 14 12:34:12 user nova-compute[73012]:     <acpi/>
Aug 14 12:34:12 user nova-compute[73012]:     <apic/>
Aug 14 12:34:12 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:34:12 user nova-compute[73012]:   </features>
Aug 14 12:34:12 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:34:12 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:34:12 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:34:12 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:34:12 user nova-compute[73012]:   </clock>
Aug 14 12:34:12 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:34:12 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:34:12 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:34:12 user nova-compute[73012]:   </cpu>
Aug 14 12:34:12 user nova-compute[73012]:   <devices>
Aug 14 12:34:12 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:34:12 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:34:12 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk"/>
Aug 14 12:34:12 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:34:12 user nova-compute[73012]:     </disk>
Aug 14 12:34:12 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:34:12 user nova-compute[73012]:       <mac address="fa:16:3e:d2:28:aa"/>
Aug 14 12:34:12 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:34:12 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:34:12 user nova-compute[73012]:       <target dev="tap2a969928-59"/>
Aug 14 12:34:12 user nova-compute[73012]:     </interface>
Aug 14 12:34:12 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:34:12 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/console.log" append="off"/>
Aug 14 12:34:12 user nova-compute[73012]:     </serial>
Aug 14 12:34:12 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:34:12 user nova-compute[73012]:     <video>
Aug 14 12:34:12 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:34:12 user nova-compute[73012]:     </video>
Aug 14 12:34:12 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:34:12 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:34:12 user nova-compute[73012]:     </rng>
Aug 14 12:34:12 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:34:12 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:34:12 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:34:12 user nova-compute[73012]:     </memballoon>
Aug 14 12:34:12 user nova-compute[73012]:   </devices>
Aug 14 12:34:12 user nova-compute[73012]: </domain>
Aug 14 12:34:12 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2026622822',display_name='tempest-AttachVolumeNegativeTest-server-2026622822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2026622822',id=42,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL187sl9LBt/6lAy2MwftUu7NVFLrlKFY9BaN6oMzXVl+F13GNqEjQxosSDf37Mpt5eA4oToLgaMVUH1X9MGdz1JALeuOBbE4S4uHi3hM5Sc13SrHJ/pJgwF3kuloTI1dw==',key_name='tempest-keypair-202284652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-kufkoug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=4f892efc-9623-4dff-b540-291c55639499,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:28:aa,bridge_name='br-int',has_traffic_filtering=True,id=2a969928-5934-417f-b66e-7a61c0946c3a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a969928-59') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG os_vif [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:28:aa,bridge_name='br-int',has_traffic_filtering=True,id=2a969928-5934-417f-b66e-7a61c0946c3a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a969928-59') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a969928-59, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a969928-59, col_values=(('external_ids', {'iface-id': '2a969928-5934-417f-b66e-7a61c0946c3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:28:aa', 'vm-uuid': '4f892efc-9623-4dff-b540-291c55639499'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:12 user nova-compute[73012]: INFO os_vif [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:28:aa,bridge_name='br-int',has_traffic_filtering=True,id=2a969928-5934-417f-b66e-7a61c0946c3a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a969928-59')
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:34:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No VIF found with MAC fa:16:3e:d2:28:aa, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-ecfa0e84-6fd5-4a09-a056-0c05416fc1ce req-60a2adf3-ceb1-4bcd-ac22-087cee2c9bb3 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Updated VIF entry in instance network info cache for port 2a969928-5934-417f-b66e-7a61c0946c3a. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-ecfa0e84-6fd5-4a09-a056-0c05416fc1ce req-60a2adf3-ceb1-4bcd-ac22-087cee2c9bb3 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Updating instance_info_cache with network_info: [{"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ecfa0e84-6fd5-4a09-a056-0c05416fc1ce req-60a2adf3-ceb1-4bcd-ac22-087cee2c9bb3 service nova] Releasing lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Releasing lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Creating tmpfile /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/tmp7don8437 to verify with other compute node that the instance is on the same shared storage. {{(pid=73012) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:34:14 user nova-compute[73012]: WARNING nova.compute.manager [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state resized and task_state resize_reverting.
Aug 14 12:34:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:34:14 user nova-compute[73012]: WARNING nova.compute.manager [req-abc3de65-0390-46bc-bea5-73154efbd477 req-d616776a-f8a2-489d-99c9-207f2c597f83 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state resized and task_state resize_reverting.
Aug 14 12:34:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance destroyed successfully.
Aug 14 12:34:14 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'resources' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-683919669',display_name='tempest-ServerActionsTestOtherB-server-683919669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-683919669',id=37,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVjrJiYPu6VYHnut5LdA0Riwd5ahrXlC4jKtuzbgu4gaPK7GwJ6AlbseM7ClHweAl3Etw8IhYAGZR1UXBZkzmwzGLDvStrigStIDDCoqd0aV5jAHV9FbuiI+5NM0Xr4Q==',key_name='tempest-keypair-284235109',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a071f634fe4f46aaab5408abc931ac4b',ramdisk_id='',reservation_id='r-70vm0iqa',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539296427',owner_user_name='tempest-ServerActionsTestOtherB-539296427-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:32:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84931e0fc1e64b1fb176f88e0a5fffb9',uuid=6c72a6b0-188c-486a-b6c8-4f2c0d2ae371,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converting VIF {"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG os_vif [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29ec9f44-ed, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:34:14 user nova-compute[73012]: INFO os_vif [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed')
Aug 14 12:34:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:34:14 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:34:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd7b18e-f39f-4f11-8331-1022d7af6b4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8867e6-3d4a-4ca3-b446-7ad9cd5b9641]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:34:15 user nova-compute[73012]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:34:15 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:34:15 user nova-compute[73012]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:34:15 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aacf73520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[48626d7e-4f57-4dec-8688-b094bd3a47c0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a079a7-7ceb-4f56-9cc5-f387661b1ceb]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8895540-691f-4ba8-a9aa-a29f56d3c810]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb6a9e-5b77-45f5-9fdd-3aae13839991]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab820e5-840a-4cd9-91c6-8270fca7525f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8506a2ce-0006-4f3a-b0cd-4ccfa208f23c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]
Aug 14 12:34:15 user nova-compute[73012]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.
Aug 14 12:34:15 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[482cc38c-5af2-4a64-987c-f87af814b98b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.670s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] <== disconnect_volume: return (671ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:34:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016456.7924943, 4f892efc-9623-4dff-b540-291c55639499 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:34:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] VM Resumed (Lifecycle Event)
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:34:16 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4f892efc-9623-4dff-b540-291c55639499] Instance spawned successfully.
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'migration_context' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received event network-vif-plugged-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] Lock "4f892efc-9623-4dff-b540-291c55639499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] Lock "4f892efc-9623-4dff-b540-291c55639499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] No waiting events found dispatching network-vif-plugged-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:34:16 user nova-compute[73012]: WARNING nova.compute.manager [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received unexpected event network-vif-plugged-2a969928-5934-417f-b66e-7a61c0946c3a for instance with vm_state building and task_state spawning.
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received event network-vif-plugged-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] Lock "4f892efc-9623-4dff-b540-291c55639499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] Lock "4f892efc-9623-4dff-b540-291c55639499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] No waiting events found dispatching network-vif-plugged-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:34:16 user nova-compute[73012]: WARNING nova.compute.manager [req-72c64bc5-8b01-4669-970f-34711bd2273a req-fbbdf940-159a-4a39-a945-f383fb877376 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received unexpected event network-vif-plugged-2a969928-5934-417f-b66e-7a61c0946c3a for instance with vm_state building and task_state spawning.
Aug 14 12:34:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016456.7982237, 4f892efc-9623-4dff-b540-291c55639499 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:34:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] VM Started (Lifecycle Event)
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:34:16 user nova-compute[73012]: INFO nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:34:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:34:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:34:17 user nova-compute[73012]: INFO nova.compute.manager [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Took 7.08 seconds to build instance.
Aug 14 12:34:17 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:34:17 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:34:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-16d27761-5f09-47bf-a0d1-b0204f3be33c tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.211s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.353s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:17 user nova-compute[73012]: INFO nova.compute.manager [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Swapping old allocation on dict_keys(['18c3368b-9ede-4a07-be2d-712c9b5eb568']) held by migration 38730336-22a5-4178-b0fb-b091558051f9 for instance
Aug 14 12:34:17 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Overwriting current allocation {'allocations': {'18c3368b-9ede-4a07-be2d-712c9b5eb568': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 52}}, 'project_id': 'a071f634fe4f46aaab5408abc931ac4b', 'user_id': '84931e0fc1e64b1fb176f88e0a5fffb9', 'consumer_generation': 1} on consumer 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 14 12:34:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:34:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquired lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:34:17 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:34:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG nova.network.neutron [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Releasing lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG os_brick.utils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c15e4a-7533-45dc-942d-df30f86fe1f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[71454cf9-b07b-47ab-8114-562c3cb7b6c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2515664-8430-430a-a2cb-19d7fdf1f9c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f13de12-beb1-43a8-b756-3d3955907e13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:34:18 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:34:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ca7deb-59a6-4b76-94b9-7efb355317a3]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:34:18 user nova-compute[73012]: DEBUG os_brick.utils [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:34:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Starting finish_revert_migration {{(pid=73012) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Start _get_guest_xml network_info=[{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6c72a6b0-188c-486a-b6c8-4f2c0d2ae371', 'attached_at': '2023-08-14T12:34:28.000000', 'detached_at': '', 'volume_id': '46290eca-8586-4527-bf66-4d04f8176136', 'serial': '46290eca-8586-4527-bf66-4d04f8176136'}, 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'cdf2b438-4860-4e7d-861b-22b690407225', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:34:27 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:34:27 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:34:27 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:34:27 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:34:27 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c8c218-6a22-411a-bcdc-97ad684719da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:34:27 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aac22df-04ab-4bbf-ad52-9c5d9dc31ad7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136] added
Aug 14 12:34:27 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[087c3978-c620-4129-a5e3-10b87558702b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f15a0a-411a-49df-8150-a3a54a7b3c0b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEkDudnI {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEkDudnI" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa5a85-0834-49db-91f8-8c93ea938b98]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gEkDudnI'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7916e00-e125-4fa7-884a-eacdcbd9be9e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd7ee01-ad58-47f5-86f3-cd7b7fb009d1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:34:27 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:34:27 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:34:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[169d453f-dcf6-45e3-852b-8926c93dbec5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]
Aug 14 12:34:28 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.
Aug 14 12:34:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cca98a3-3803-49ac-90f4-effaeaee92e0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bb04c7-8bc5-421c-a3cb-cbfd9dc6dc6b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:34:28 user nova-compute[73012]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:34:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:34:28 user nova-compute[73012]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:34:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2852bf7e-c89e-428c-b64a-9f08c17e38fe]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:34:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23566323835396135', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323835396135', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-683919669',display_name='tempest-ServerActionsTestOtherB-server-683919669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-683919669',id=37,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVjrJiYPu6VYHnut5LdA0Riwd5ahrXlC4jKtuzbgu4gaPK7GwJ6AlbseM7ClHweAl3Etw8IhYAGZR1UXBZkzmwzGLDvStrigStIDDCoqd0aV5jAHV9FbuiI+5NM0Xr4Q==',key_name='tempest-keypair-284235109',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a071f634fe4f46aaab5408abc931ac4b',ramdisk_id='',reservation_id='r-70vm0iqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539296427',owner_user_name='tempest-ServerActionsTestOtherB-539296427-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84931e0fc1e64b1fb176f88e0a5fffb9',uuid=6c72a6b0-188c-486a-b6c8-4f2c0d2ae371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converting VIF {"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:34:29 user nova-compute[73012]:   <uuid>6c72a6b0-188c-486a-b6c8-4f2c0d2ae371</uuid>
Aug 14 12:34:29 user nova-compute[73012]:   <name>instance-00000025</name>
Aug 14 12:34:29 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:34:29 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:34:29 user nova-compute[73012]:   <metadata>
Aug 14 12:34:29 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:34:29 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:34:29 user nova-compute[73012]:       <nova:name>tempest-ServerActionsTestOtherB-server-683919669</nova:name>
Aug 14 12:34:29 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:34:27</nova:creationTime>
Aug 14 12:34:29 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:34:29 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:34:29 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:34:29 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:34:29 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:34:29 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:34:29 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:34:29 user nova-compute[73012]:       <nova:owner>
Aug 14 12:34:29 user nova-compute[73012]:         <nova:user uuid="84931e0fc1e64b1fb176f88e0a5fffb9">tempest-ServerActionsTestOtherB-539296427-project-member</nova:user>
Aug 14 12:34:29 user nova-compute[73012]:         <nova:project uuid="a071f634fe4f46aaab5408abc931ac4b">tempest-ServerActionsTestOtherB-539296427</nova:project>
Aug 14 12:34:29 user nova-compute[73012]:       </nova:owner>
Aug 14 12:34:29 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:34:29 user nova-compute[73012]:       <nova:ports>
Aug 14 12:34:29 user nova-compute[73012]:         <nova:port uuid="29ec9f44-ed38-45b5-bafe-41aff2453e83">
Aug 14 12:34:29 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:34:29 user nova-compute[73012]:         </nova:port>
Aug 14 12:34:29 user nova-compute[73012]:       </nova:ports>
Aug 14 12:34:29 user nova-compute[73012]:     </nova:instance>
Aug 14 12:34:29 user nova-compute[73012]:   </metadata>
Aug 14 12:34:29 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:34:29 user nova-compute[73012]:     <system>
Aug 14 12:34:29 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:34:29 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:34:29 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:34:29 user nova-compute[73012]:       <entry name="serial">6c72a6b0-188c-486a-b6c8-4f2c0d2ae371</entry>
Aug 14 12:34:29 user nova-compute[73012]:       <entry name="uuid">6c72a6b0-188c-486a-b6c8-4f2c0d2ae371</entry>
Aug 14 12:34:29 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:34:29 user nova-compute[73012]:     </system>
Aug 14 12:34:29 user nova-compute[73012]:   </sysinfo>
Aug 14 12:34:29 user nova-compute[73012]:   <os>
Aug 14 12:34:29 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:34:29 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:34:29 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:34:29 user nova-compute[73012]:   </os>
Aug 14 12:34:29 user nova-compute[73012]:   <features>
Aug 14 12:34:29 user nova-compute[73012]:     <acpi/>
Aug 14 12:34:29 user nova-compute[73012]:     <apic/>
Aug 14 12:34:29 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:34:29 user nova-compute[73012]:   </features>
Aug 14 12:34:29 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:34:29 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:34:29 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:34:29 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:34:29 user nova-compute[73012]:   </clock>
Aug 14 12:34:29 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:34:29 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:34:29 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:34:29 user nova-compute[73012]:   </cpu>
Aug 14 12:34:29 user nova-compute[73012]:   <devices>
Aug 14 12:34:29 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:34:29 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:34:29 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk"/>
Aug 14 12:34:29 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:34:29 user nova-compute[73012]:     </disk>
Aug 14 12:34:29 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:34:29 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:34:29 user nova-compute[73012]:       <source dev="/dev/sdc"/>
Aug 14 12:34:29 user nova-compute[73012]:       <target dev="vdb" bus="virtio"/>
Aug 14 12:34:29 user nova-compute[73012]:       <serial>46290eca-8586-4527-bf66-4d04f8176136</serial>
Aug 14 12:34:29 user nova-compute[73012]:     </disk>
Aug 14 12:34:29 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:34:29 user nova-compute[73012]:       <mac address="fa:16:3e:88:d7:00"/>
Aug 14 12:34:29 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:34:29 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:34:29 user nova-compute[73012]:       <target dev="tap29ec9f44-ed"/>
Aug 14 12:34:29 user nova-compute[73012]:     </interface>
Aug 14 12:34:29 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:34:29 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/console.log" append="off"/>
Aug 14 12:34:29 user nova-compute[73012]:     </serial>
Aug 14 12:34:29 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:34:29 user nova-compute[73012]:     <video>
Aug 14 12:34:29 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:34:29 user nova-compute[73012]:     </video>
Aug 14 12:34:29 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:34:29 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:34:29 user nova-compute[73012]:     </rng>
Aug 14 12:34:29 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:34:29 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:34:29 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:34:29 user nova-compute[73012]:     </memballoon>
Aug 14 12:34:29 user nova-compute[73012]:   </devices>
Aug 14 12:34:29 user nova-compute[73012]: </domain>
Aug 14 12:34:29 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-683919669',display_name='tempest-ServerActionsTestOtherB-server-683919669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-683919669',id=37,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVjrJiYPu6VYHnut5LdA0Riwd5ahrXlC4jKtuzbgu4gaPK7GwJ6AlbseM7ClHweAl3Etw8IhYAGZR1UXBZkzmwzGLDvStrigStIDDCoqd0aV5jAHV9FbuiI+5NM0Xr4Q==',key_name='tempest-keypair-284235109',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a071f634fe4f46aaab5408abc931ac4b',ramdisk_id='',reservation_id='r-70vm0iqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539296427',owner_user_name='tempest-ServerActionsTestOtherB-539296427-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84931e0fc1e64b1fb176f88e0a5fffb9',uuid=6c72a6b0-188c-486a-b6c8-4f2c0d2ae371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converting VIF {"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG os_vif [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29ec9f44-ed, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29ec9f44-ed, col_values=(('external_ids', {'iface-id': '29ec9f44-ed38-45b5-bafe-41aff2453e83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:d7:00', 'vm-uuid': '6c72a6b0-188c-486a-b6c8-4f2c0d2ae371'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:34:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:29 user nova-compute[73012]: INFO os_vif [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed')
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016454.887779, 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:34:29 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] VM Stopped (Lifecycle Event)
Aug 14 12:34:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cc1ef2e0-8512-4934-a037-686a00fcd079 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquiring lock "39ee4a24-3552-446e-a30b-24999e857044" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "39ee4a24-3552-446e-a30b-24999e857044" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:34:30 user nova-compute[73012]: INFO nova.compute.claims [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Claim successful on node user
Aug 14 12:34:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-049cd842-5ae4-4eff-b779-0b9814a0a719 req-3c050817-4816-42e7-a4b3-7f6b5abeeb3d service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-049cd842-5ae4-4eff-b779-0b9814a0a719 req-3c050817-4816-42e7-a4b3-7f6b5abeeb3d service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-049cd842-5ae4-4eff-b779-0b9814a0a719 req-3c050817-4816-42e7-a4b3-7f6b5abeeb3d service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-049cd842-5ae4-4eff-b779-0b9814a0a719 req-3c050817-4816-42e7-a4b3-7f6b5abeeb3d service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG nova.compute.manager [req-049cd842-5ae4-4eff-b779-0b9814a0a719 req-3c050817-4816-42e7-a4b3-7f6b5abeeb3d service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:34:30 user nova-compute[73012]: WARNING nova.compute.manager [req-049cd842-5ae4-4eff-b779-0b9814a0a719 req-3c050817-4816-42e7-a4b3-7f6b5abeeb3d service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state resized and task_state resize_reverting.
Aug 14 12:34:30 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:34:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:34:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:34:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Creating image(s)
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquiring lock "/opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "/opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "/opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG nova.policy [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c027a2d42444181916a2503b63ef723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab0b873b7df4a0fa5b8f6e64bf445ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.207s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk 1073741824" returned: 0 in 0.060s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.187s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:34:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Cannot resize image /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.objects.instance [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lazy-loading 'migration_context' on Instance uuid 39ee4a24-3552-446e-a30b-24999e857044 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Ensure instance console log exists: /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Successfully created port: b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-d8c3060b-a695-4aab-b5d7-91bcd0185de5 req-3951f860-e7e9-42b9-a4b5-67dea70aad01 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d8c3060b-a695-4aab-b5d7-91bcd0185de5 req-3951f860-e7e9-42b9-a4b5-67dea70aad01 service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d8c3060b-a695-4aab-b5d7-91bcd0185de5 req-3951f860-e7e9-42b9-a4b5-67dea70aad01 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d8c3060b-a695-4aab-b5d7-91bcd0185de5 req-3951f860-e7e9-42b9-a4b5-67dea70aad01 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-d8c3060b-a695-4aab-b5d7-91bcd0185de5 req-3951f860-e7e9-42b9-a4b5-67dea70aad01 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:34:32 user nova-compute[73012]: WARNING nova.compute.manager [req-d8c3060b-a695-4aab-b5d7-91bcd0185de5 req-3951f860-e7e9-42b9-a4b5-67dea70aad01 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state resized and task_state resize_reverting.
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016472.810016, 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:34:32 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] VM Resumed (Lifecycle Event)
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:34:32 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance running successfully.
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] finish_revert_migration finished successfully. {{(pid=73012) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:34:32 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016472.8118436, 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:34:32 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] VM Started (Lifecycle Event)
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:34:32 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Successfully updated port: b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquiring lock "refresh_cache-39ee4a24-3552-446e-a30b-24999e857044" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquired lock "refresh_cache-39ee4a24-3552-446e-a30b-24999e857044" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:34:32 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:34:32 user nova-compute[73012]: INFO nova.compute.manager [None req-cbf566ca-8480-43ab-8714-d548ae869a50 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance to original state: 'active'
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Updating instance_info_cache with network_info: [{"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Releasing lock "refresh_cache-39ee4a24-3552-446e-a30b-24999e857044" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Instance network_info: |[{"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Start _get_guest_xml network_info=[{"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:34:33 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:34:33 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1754615478',display_name='tempest-VolumesNegativeTest-instance-1754615478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1754615478',id=43,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab0b873b7df4a0fa5b8f6e64bf445ab',ramdisk_id='',reservation_id='r-0212aurt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1034914460',owner_user_name='tempest-VolumesNegativeTest-1034914460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:34:31Z,user_data=None,user_id='3c027a2d42444181916a2503b63ef723',uuid=39ee4a24-3552-446e-a30b-24999e857044,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Converting VIF {"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:70:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2bd3627-8688-410a-8aec-0a8ea49db7f7,network=Network(6c1092ef-335b-4c66-9878-d4f5120aaee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bd3627-86') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.objects.instance [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lazy-loading 'pci_devices' on Instance uuid 39ee4a24-3552-446e-a30b-24999e857044 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:34:33 user nova-compute[73012]:   <uuid>39ee4a24-3552-446e-a30b-24999e857044</uuid>
Aug 14 12:34:33 user nova-compute[73012]:   <name>instance-0000002b</name>
Aug 14 12:34:33 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:34:33 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:34:33 user nova-compute[73012]:   <metadata>
Aug 14 12:34:33 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:34:33 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:34:33 user nova-compute[73012]:       <nova:name>tempest-VolumesNegativeTest-instance-1754615478</nova:name>
Aug 14 12:34:33 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:34:33</nova:creationTime>
Aug 14 12:34:33 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:34:33 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:34:33 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:34:33 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:34:33 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:34:33 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:34:33 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:34:33 user nova-compute[73012]:       <nova:owner>
Aug 14 12:34:33 user nova-compute[73012]:         <nova:user uuid="3c027a2d42444181916a2503b63ef723">tempest-VolumesNegativeTest-1034914460-project-member</nova:user>
Aug 14 12:34:33 user nova-compute[73012]:         <nova:project uuid="bab0b873b7df4a0fa5b8f6e64bf445ab">tempest-VolumesNegativeTest-1034914460</nova:project>
Aug 14 12:34:33 user nova-compute[73012]:       </nova:owner>
Aug 14 12:34:33 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:34:33 user nova-compute[73012]:       <nova:ports>
Aug 14 12:34:33 user nova-compute[73012]:         <nova:port uuid="b2bd3627-8688-410a-8aec-0a8ea49db7f7">
Aug 14 12:34:33 user nova-compute[73012]:           <nova:ip type="fixed" address="192.168.233.211" ipVersion="4"/>
Aug 14 12:34:33 user nova-compute[73012]:         </nova:port>
Aug 14 12:34:33 user nova-compute[73012]:       </nova:ports>
Aug 14 12:34:33 user nova-compute[73012]:     </nova:instance>
Aug 14 12:34:33 user nova-compute[73012]:   </metadata>
Aug 14 12:34:33 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:34:33 user nova-compute[73012]:     <system>
Aug 14 12:34:33 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:34:33 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:34:33 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:34:33 user nova-compute[73012]:       <entry name="serial">39ee4a24-3552-446e-a30b-24999e857044</entry>
Aug 14 12:34:33 user nova-compute[73012]:       <entry name="uuid">39ee4a24-3552-446e-a30b-24999e857044</entry>
Aug 14 12:34:33 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:34:33 user nova-compute[73012]:     </system>
Aug 14 12:34:33 user nova-compute[73012]:   </sysinfo>
Aug 14 12:34:33 user nova-compute[73012]:   <os>
Aug 14 12:34:33 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:34:33 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:34:33 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:34:33 user nova-compute[73012]:   </os>
Aug 14 12:34:33 user nova-compute[73012]:   <features>
Aug 14 12:34:33 user nova-compute[73012]:     <acpi/>
Aug 14 12:34:33 user nova-compute[73012]:     <apic/>
Aug 14 12:34:33 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:34:33 user nova-compute[73012]:   </features>
Aug 14 12:34:33 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:34:33 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:34:33 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:34:33 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:34:33 user nova-compute[73012]:   </clock>
Aug 14 12:34:33 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:34:33 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:34:33 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:34:33 user nova-compute[73012]:   </cpu>
Aug 14 12:34:33 user nova-compute[73012]:   <devices>
Aug 14 12:34:33 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:34:33 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:34:33 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk"/>
Aug 14 12:34:33 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:34:33 user nova-compute[73012]:     </disk>
Aug 14 12:34:33 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:34:33 user nova-compute[73012]:       <mac address="fa:16:3e:b6:70:f0"/>
Aug 14 12:34:33 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:34:33 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:34:33 user nova-compute[73012]:       <target dev="tapb2bd3627-86"/>
Aug 14 12:34:33 user nova-compute[73012]:     </interface>
Aug 14 12:34:33 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:34:33 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/console.log" append="off"/>
Aug 14 12:34:33 user nova-compute[73012]:     </serial>
Aug 14 12:34:33 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:34:33 user nova-compute[73012]:     <video>
Aug 14 12:34:33 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:34:33 user nova-compute[73012]:     </video>
Aug 14 12:34:33 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:34:33 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:34:33 user nova-compute[73012]:     </rng>
Aug 14 12:34:33 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:34:33 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:34:33 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:34:33 user nova-compute[73012]:     </memballoon>
Aug 14 12:34:33 user nova-compute[73012]:   </devices>
Aug 14 12:34:33 user nova-compute[73012]: </domain>
Aug 14 12:34:33 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1754615478',display_name='tempest-VolumesNegativeTest-instance-1754615478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1754615478',id=43,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bab0b873b7df4a0fa5b8f6e64bf445ab',ramdisk_id='',reservation_id='r-0212aurt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1034914460',owner_user_name='tempest-VolumesNegativeTest-1034914460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:34:31Z,user_data=None,user_id='3c027a2d42444181916a2503b63ef723',uuid=39ee4a24-3552-446e-a30b-24999e857044,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Converting VIF {"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:70:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2bd3627-8688-410a-8aec-0a8ea49db7f7,network=Network(6c1092ef-335b-4c66-9878-d4f5120aaee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bd3627-86') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG os_vif [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:70:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2bd3627-8688-410a-8aec-0a8ea49db7f7,network=Network(6c1092ef-335b-4c66-9878-d4f5120aaee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bd3627-86') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2bd3627-86, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2bd3627-86, col_values=(('external_ids', {'iface-id': 'b2bd3627-8688-410a-8aec-0a8ea49db7f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:70:f0', 'vm-uuid': '39ee4a24-3552-446e-a30b-24999e857044'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:33 user nova-compute[73012]: INFO os_vif [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:70:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2bd3627-8688-410a-8aec-0a8ea49db7f7,network=Network(6c1092ef-335b-4c66-9878-d4f5120aaee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bd3627-86')
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:34:33 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] No VIF found with MAC fa:16:3e:b6:70:f0, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:34:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-a1731697-5819-45ab-9443-c2f186134f7e req-39f6131f-0edf-4dc5-a6e7-a42601cca518 service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received event network-changed-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:34 user nova-compute[73012]: DEBUG nova.compute.manager [req-a1731697-5819-45ab-9443-c2f186134f7e req-39f6131f-0edf-4dc5-a6e7-a42601cca518 service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Refreshing instance network info cache due to event network-changed-b2bd3627-8688-410a-8aec-0a8ea49db7f7. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:34:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a1731697-5819-45ab-9443-c2f186134f7e req-39f6131f-0edf-4dc5-a6e7-a42601cca518 service nova] Acquiring lock "refresh_cache-39ee4a24-3552-446e-a30b-24999e857044" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:34:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a1731697-5819-45ab-9443-c2f186134f7e req-39f6131f-0edf-4dc5-a6e7-a42601cca518 service nova] Acquired lock "refresh_cache-39ee4a24-3552-446e-a30b-24999e857044" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:34:34 user nova-compute[73012]: DEBUG nova.network.neutron [req-a1731697-5819-45ab-9443-c2f186134f7e req-39f6131f-0edf-4dc5-a6e7-a42601cca518 service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Refreshing network info cache for port b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:34:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:35 user nova-compute[73012]: DEBUG nova.network.neutron [req-a1731697-5819-45ab-9443-c2f186134f7e req-39f6131f-0edf-4dc5-a6e7-a42601cca518 service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Updated VIF entry in instance network info cache for port b2bd3627-8688-410a-8aec-0a8ea49db7f7. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:34:35 user nova-compute[73012]: DEBUG nova.network.neutron [req-a1731697-5819-45ab-9443-c2f186134f7e req-39f6131f-0edf-4dc5-a6e7-a42601cca518 service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Updating instance_info_cache with network_info: [{"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:34:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a1731697-5819-45ab-9443-c2f186134f7e req-39f6131f-0edf-4dc5-a6e7-a42601cca518 service nova] Releasing lock "refresh_cache-39ee4a24-3552-446e-a30b-24999e857044" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received event network-vif-plugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] Acquiring lock "39ee4a24-3552-446e-a30b-24999e857044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] No waiting events found dispatching network-vif-plugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:34:36 user nova-compute[73012]: WARNING nova.compute.manager [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received unexpected event network-vif-plugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 for instance with vm_state building and task_state spawning.
Aug 14 12:34:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received event network-vif-plugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] Acquiring lock "39ee4a24-3552-446e-a30b-24999e857044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] No waiting events found dispatching network-vif-plugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:34:36 user nova-compute[73012]: WARNING nova.compute.manager [req-0efa8b7b-279c-4b00-b05e-d93f5349693c req-84f62e9d-3820-4962-bba5-050918a7eb8e service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received unexpected event network-vif-plugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 for instance with vm_state building and task_state spawning.
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016477.1726375, 39ee4a24-3552-446e-a30b-24999e857044 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:34:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 39ee4a24-3552-446e-a30b-24999e857044] VM Resumed (Lifecycle Event)
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:34:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Instance spawned successfully.
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:34:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 39ee4a24-3552-446e-a30b-24999e857044] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016477.1758792, 39ee4a24-3552-446e-a30b-24999e857044 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:34:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 39ee4a24-3552-446e-a30b-24999e857044] VM Started (Lifecycle Event)
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:34:37 user nova-compute[73012]: INFO nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Took 6.07 seconds to spawn the instance on the hypervisor.
Aug 14 12:34:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:34:37 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 39ee4a24-3552-446e-a30b-24999e857044] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:34:37 user nova-compute[73012]: INFO nova.compute.manager [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Took 6.80 seconds to build instance.
Aug 14 12:34:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-4c4e97e3-e6ce-4bd8-a348-3fe949026aa3 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "39ee4a24-3552-446e-a30b-24999e857044" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.939s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:48 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:48 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:34:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:34:48 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:49 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:34:50 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:34:50 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8106MB free_disk=25.413616180419922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance ae462e6f-d5d9-43a6-ae26-b4b07f89350f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f892efc-9623-4dff-b540-291c55639499 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 39ee4a24-3552-446e-a30b-24999e857044 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:34:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:34:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:34:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:34:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-816757b5-1106-418c-aebb-81fdbbe02613 req-e4ec933e-cd1f-43dc-8b42-898d7ee67e1c service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received event network-changed-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-816757b5-1106-418c-aebb-81fdbbe02613 req-e4ec933e-cd1f-43dc-8b42-898d7ee67e1c service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Refreshing instance network info cache due to event network-changed-02bf32e8-44ad-47f3-aea2-6f9607471c5d. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816757b5-1106-418c-aebb-81fdbbe02613 req-e4ec933e-cd1f-43dc-8b42-898d7ee67e1c service nova] Acquiring lock "refresh_cache-ae462e6f-d5d9-43a6-ae26-b4b07f89350f" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816757b5-1106-418c-aebb-81fdbbe02613 req-e4ec933e-cd1f-43dc-8b42-898d7ee67e1c service nova] Acquired lock "refresh_cache-ae462e6f-d5d9-43a6-ae26-b4b07f89350f" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-816757b5-1106-418c-aebb-81fdbbe02613 req-e4ec933e-cd1f-43dc-8b42-898d7ee67e1c service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Refreshing network info cache for port 02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-816757b5-1106-418c-aebb-81fdbbe02613 req-e4ec933e-cd1f-43dc-8b42-898d7ee67e1c service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Updated VIF entry in instance network info cache for port 02bf32e8-44ad-47f3-aea2-6f9607471c5d. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-816757b5-1106-418c-aebb-81fdbbe02613 req-e4ec933e-cd1f-43dc-8b42-898d7ee67e1c service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Updating instance_info_cache with network_info: [{"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:34:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-816757b5-1106-418c-aebb-81fdbbe02613 req-e4ec933e-cd1f-43dc-8b42-898d7ee67e1c service nova] Releasing lock "refresh_cache-ae462e6f-d5d9-43a6-ae26-b4b07f89350f" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:34:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:34:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:34:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:34:59 user nova-compute[73012]: INFO nova.compute.manager [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Terminating instance
Aug 14 12:34:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-8d12ccf0-a3f6-4a05-9e02-416bee609c5c req-3f123c6f-4dac-4b19-8817-d740431c8257 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received event network-vif-unplugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8d12ccf0-a3f6-4a05-9e02-416bee609c5c req-3f123c6f-4dac-4b19-8817-d740431c8257 service nova] Acquiring lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8d12ccf0-a3f6-4a05-9e02-416bee609c5c req-3f123c6f-4dac-4b19-8817-d740431c8257 service nova] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8d12ccf0-a3f6-4a05-9e02-416bee609c5c req-3f123c6f-4dac-4b19-8817-d740431c8257 service nova] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-8d12ccf0-a3f6-4a05-9e02-416bee609c5c req-3f123c6f-4dac-4b19-8817-d740431c8257 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] No waiting events found dispatching network-vif-unplugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-8d12ccf0-a3f6-4a05-9e02-416bee609c5c req-3f123c6f-4dac-4b19-8817-d740431c8257 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received event network-vif-unplugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:35:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Instance destroyed successfully.
Aug 14 12:35:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'resources' on Instance uuid ae462e6f-d5d9-43a6-ae26-b4b07f89350f {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-773287673',display_name='tempest-TestVolumeBootPattern-server-773287673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-773287673',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg7lN4gu0O9CJgDpyBhy0RX3jSYGXDmrd1kKjcONe+vy3hXe0gfOqavEjgU06+fs+8PvDAL8t8WC3udIvRk5S68ldJhrYI9gy8tZpcPsibRZmE5rDqMVaBs/gzMf1AsPA==',key_name='tempest-TestVolumeBootPattern-1852675789',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:33:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-0side43x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:33:20Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=ae462e6f-d5d9-43a6-ae26-b4b07f89350f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "address": "fa:16:3e:5f:37:35", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02bf32e8-44", "ovs_interfaceid": "02bf32e8-44ad-47f3-aea2-6f9607471c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:37:35,bridge_name='br-int',has_traffic_filtering=True,id=02bf32e8-44ad-47f3-aea2-6f9607471c5d,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bf32e8-44') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_vif [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:37:35,bridge_name='br-int',has_traffic_filtering=True,id=02bf32e8-44ad-47f3-aea2-6f9607471c5d,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bf32e8-44') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02bf32e8-44, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:00 user nova-compute[73012]: INFO os_vif [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:37:35,bridge_name='br-int',has_traffic_filtering=True,id=02bf32e8-44ad-47f3-aea2-6f9607471c5d,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02bf32e8-44')
Aug 14 12:35:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyeaRgFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:35:00 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e2e92b-5891-4af0-b45b-f6a86b22ce1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83c9e83-8ec2-4d9a-9c52-eced57f11f4b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:35:00 user nova-compute[73012]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:35:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:35:00 user nova-compute[73012]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:35:00 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad012fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc5bc22-5968-4b32-9c10-9b2c44c1d482]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[97afa1bb-e870-48f6-8265-16dbec80655c]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8210337a-17c1-49e0-9fd4-b6b3dfea6745]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[532f3948-c86c-48ba-b098-53438e61d3a6]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23132363736383832', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bfa8fb48', '/dev/disk/by-id/scsi-1SCST_BIObfa8fb48-126768823d60d1f5') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c34cf9-3076-42d6-8ae9-3f6d5aa2b0e7]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33b6140-2a4a-4083-a1f2-923cea943540]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:35:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[201059a4-671a-4320-839a-8072bdd3f916]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260]
Aug 14 12:35:01 user nova-compute[73012]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260] successful.
Aug 14 12:35:01 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ec4917-5aa3-4483-804f-92bb617cb535]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== disconnect_volume: return (309ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:35:01 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Deleting instance files /opt/stack/data/nova/instances/ae462e6f-d5d9-43a6-ae26-b4b07f89350f_del
Aug 14 12:35:01 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Deletion of /opt/stack/data/nova/instances/ae462e6f-d5d9-43a6-ae26-b4b07f89350f_del complete
Aug 14 12:35:01 user nova-compute[73012]: INFO nova.compute.manager [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 14 12:35:01 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:35:01 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:35:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-fa7830ca-614b-49d4-98cb-076d90136164 req-47b012e7-bd52-4f41-acff-334c7f815339 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received event network-vif-deleted-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:35:02 user nova-compute[73012]: INFO nova.compute.manager [req-fa7830ca-614b-49d4-98cb-076d90136164 req-47b012e7-bd52-4f41-acff-334c7f815339 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Neutron deleted interface 02bf32e8-44ad-47f3-aea2-6f9607471c5d; detaching it from the instance and deleting it from the info cache
Aug 14 12:35:02 user nova-compute[73012]: DEBUG nova.network.neutron [req-fa7830ca-614b-49d4-98cb-076d90136164 req-47b012e7-bd52-4f41-acff-334c7f815339 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:35:02 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:35:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-fa7830ca-614b-49d4-98cb-076d90136164 req-47b012e7-bd52-4f41-acff-334c7f815339 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Detach interface failed, port_id=02bf32e8-44ad-47f3-aea2-6f9607471c5d, reason: Instance ae462e6f-d5d9-43a6-ae26-b4b07f89350f could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:35:02 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Took 1.30 seconds to deallocate network for instance.
Aug 14 12:35:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-fe75ecd2-ab26-4f2a-95ef-56c4c94a63f8 req-68470b24-92ce-4c0d-ac02-731e6c21daa6 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received event network-vif-plugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:35:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fe75ecd2-ab26-4f2a-95ef-56c4c94a63f8 req-68470b24-92ce-4c0d-ac02-731e6c21daa6 service nova] Acquiring lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:35:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fe75ecd2-ab26-4f2a-95ef-56c4c94a63f8 req-68470b24-92ce-4c0d-ac02-731e6c21daa6 service nova] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:35:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fe75ecd2-ab26-4f2a-95ef-56c4c94a63f8 req-68470b24-92ce-4c0d-ac02-731e6c21daa6 service nova] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:35:02 user nova-compute[73012]: DEBUG nova.compute.manager [req-fe75ecd2-ab26-4f2a-95ef-56c4c94a63f8 req-68470b24-92ce-4c0d-ac02-731e6c21daa6 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] No waiting events found dispatching network-vif-plugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:35:02 user nova-compute[73012]: WARNING nova.compute.manager [req-fe75ecd2-ab26-4f2a-95ef-56c4c94a63f8 req-68470b24-92ce-4c0d-ac02-731e6c21daa6 service nova] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Received unexpected event network-vif-plugged-02bf32e8-44ad-47f3-aea2-6f9607471c5d for instance with vm_state active and task_state deleting.
Aug 14 12:35:03 user nova-compute[73012]: INFO nova.compute.manager [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Took 1.07 seconds to detach 1 volumes for instance.
Aug 14 12:35:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:35:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:35:03 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:35:03 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:35:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:35:03 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Deleted allocations for instance ae462e6f-d5d9-43a6-ae26-b4b07f89350f
Aug 14 12:35:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-52a528e5-26ed-449c-aff7-6f262e600992 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "ae462e6f-d5d9-43a6-ae26-b4b07f89350f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.126s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:35:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:15 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016500.7070537, ae462e6f-d5d9-43a6-ae26-b4b07f89350f => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:35:15 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] VM Stopped (Lifecycle Event)
Aug 14 12:35:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-912ff512-276f-4233-b1db-fecd77bf7abc None None] [instance: ae462e6f-d5d9-43a6-ae26-b4b07f89350f] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:35:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:35:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:35:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:35:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:35:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:35:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:35:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:35:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:35:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:35:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:35:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:35:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:50 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:35:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:35:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:35:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:35:50 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:35:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:35:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:35:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:52 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:35:52 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8412MB free_disk=25.36722183227539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f892efc-9623-4dff-b540-291c55639499 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 39ee4a24-3552-446e-a30b-24999e857044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4cfcbac9-7014-48b4-a131-2c1b83838a4b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.258s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:35:52 user nova-compute[73012]: INFO nova.compute.claims [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Claim successful on node user
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.network.neutron [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:35:52 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:35:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:35:53 user nova-compute[73012]: INFO nova.virt.block_device [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Booting with volume 03cff6c0-a19c-4526-9143-3edac05caef2 at /dev/vda
Aug 14 12:35:53 user nova-compute[73012]: DEBUG nova.policy [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0311f0fd37f143739604c409233537fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7699b5c3fcc34a619e5d0d066e8ff642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG os_brick.utils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76e3780-c371-4ea3-94ed-54e6ca147ac1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa4abf8-0bbf-4373-a5db-7323fed4e2c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b14229-f053-4940-aa55-795eb0f177fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c26bf48-afbc-467c-b538-5c161d34d80e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:35:53 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcefcf0-a274-4cfd-9d97-7b6e6c8c0786]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG os_brick.utils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updating existing volume attachment record: df641b62-aa7f-4774-b8a0-790bdfbccff0 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Skipping network cache update for instance because it is Building. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:35:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Successfully created port: d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [{"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Successfully updated port: d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquired lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c1b28f3-4673-4c02-b7a9-f9261871185b req-6b6ab36a-3d04-4397-8f8a-2e6662f4094f service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received event network-changed-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-8c1b28f3-4673-4c02-b7a9-f9261871185b req-6b6ab36a-3d04-4397-8f8a-2e6662f4094f service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Refreshing instance network info cache due to event network-changed-d473651f-b160-4ae5-a077-6b0819e9cbcb. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c1b28f3-4673-4c02-b7a9-f9261871185b req-6b6ab36a-3d04-4397-8f8a-2e6662f4094f service nova] Acquiring lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:35:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG nova.network.neutron [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updating instance_info_cache with network_info: [{"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Releasing lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Instance network_info: |[{"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c1b28f3-4673-4c02-b7a9-f9261871185b req-6b6ab36a-3d04-4397-8f8a-2e6662f4094f service nova] Acquired lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-8c1b28f3-4673-4c02-b7a9-f9261871185b req-6b6ab36a-3d04-4397-8f8a-2e6662f4094f service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Refreshing network info cache for port d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-8c1b28f3-4673-4c02-b7a9-f9261871185b req-6b6ab36a-3d04-4397-8f8a-2e6662f4094f service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updated VIF entry in instance network info cache for port d473651f-b160-4ae5-a077-6b0819e9cbcb. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-8c1b28f3-4673-4c02-b7a9-f9261871185b req-6b6ab36a-3d04-4397-8f8a-2e6662f4094f service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updating instance_info_cache with network_info: [{"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8c1b28f3-4673-4c02-b7a9-f9261871185b req-6b6ab36a-3d04-4397-8f8a-2e6662f4094f service nova] Releasing lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:35:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:35:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:00 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:36:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-37a22ae6-7dc1-4d8c-9e41-851c764e9feb req-4cace77a-094a-41ff-abb7-0d74f4003d50 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received event network-changed-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:36:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-37a22ae6-7dc1-4d8c-9e41-851c764e9feb req-4cace77a-094a-41ff-abb7-0d74f4003d50 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Refreshing instance network info cache due to event network-changed-2a969928-5934-417f-b66e-7a61c0946c3a. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:36:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-37a22ae6-7dc1-4d8c-9e41-851c764e9feb req-4cace77a-094a-41ff-abb7-0d74f4003d50 service nova] Acquiring lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:36:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-37a22ae6-7dc1-4d8c-9e41-851c764e9feb req-4cace77a-094a-41ff-abb7-0d74f4003d50 service nova] Acquired lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:36:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-37a22ae6-7dc1-4d8c-9e41-851c764e9feb req-4cace77a-094a-41ff-abb7-0d74f4003d50 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Refreshing network info cache for port 2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:36:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-37a22ae6-7dc1-4d8c-9e41-851c764e9feb req-4cace77a-094a-41ff-abb7-0d74f4003d50 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Updated VIF entry in instance network info cache for port 2a969928-5934-417f-b66e-7a61c0946c3a. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:36:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-37a22ae6-7dc1-4d8c-9e41-851c764e9feb req-4cace77a-094a-41ff-abb7-0d74f4003d50 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Updating instance_info_cache with network_info: [{"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:36:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-37a22ae6-7dc1-4d8c-9e41-851c764e9feb req-4cace77a-094a-41ff-abb7-0d74f4003d50 service nova] Releasing lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:36:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.objects.instance [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'flavor' on Instance uuid 4f892efc-9623-4dff-b540-291c55639499 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:36:10 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Creating image(s)
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Ensure instance console log exists: /opt/stack/data/nova/instances/4cfcbac9-7014-48b4-a131-2c1b83838a4b/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Start _get_guest_xml network_info=[{"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyeaRgFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4cfcbac9-7014-48b4-a131-2c1b83838a4b', 'attached_at': '', 'detached_at': '', 'volume_id': '03cff6c0-a19c-4526-9143-3edac05caef2', 'serial': '03cff6c0-a19c-4526-9143-3edac05caef2'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'df641b62-aa7f-4774-b8a0-790bdfbccff0', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:36:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:36:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyeaRgFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:36:10 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:36:10 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:36:10 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[18279bbe-1ccc-4e05-85ec-6ed3768e2b45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:36:10 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:10 user nova-compute[73012]: INFO nova.compute.manager [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Attaching volume cec1dc50-ad95-4b44-bd9c-2fb441e52ded to /dev/vdb
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ec203a-0ab3-46fe-a236-f811b5e4c284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2] added
Aug 14 12:36:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda8b6bc-8da5-46a4-a51d-cefa43aa7ce7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.utils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2589e-b4b8-444a-b637-5b4d219cd286]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyeaRgFY {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[32db3e2c-2ce7-4bd5-9c29-ca5adee95a92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyeaRgFY" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e4eb1-a70c-40c2-ae9c-38680aaef5d7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QyeaRgFY'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5c8c91-3205-43e4-9c97-23d3bf11239e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa7d478-a8bd-4e7b-9912-3d2b4244fa5a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[018c8430-c5fc-473e-8777-95036cb498a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d496e740-e751-42cc-95db-a66f2fad8016]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32ecfe0-ca71-46c4-beec-2d2fb87f9044]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:36:10 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[67df712a-44f6-4588-b3a8-9b1966b67648]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.utils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Updating existing volume attachment record: c914cc4f-8130-4b08-a0cc-91c4b62c8000 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc1ff4d-4d16-48e5-b9c2-225b17c1044b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260]
Aug 14 12:36:10 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260] successful.
Aug 14 12:36:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fc043f-e68d-4019-9389-325795dea875]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9f3d92-3731-47e4-91f8-8ca6ce4f27c2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:10 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:36:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:10 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:36:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76dbf0c-3840-4c78-9b9d-da367d2544df]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:36:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyeaRgFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23132363736383832', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132363736383832', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-95293580',display_name='tempest-TestVolumeBootPattern-server-95293580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-95293580',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg7lN4gu0O9CJgDpyBhy0RX3jSYGXDmrd1kKjcONe+vy3hXe0gfOqavEjgU06+fs+8PvDAL8t8WC3udIvRk5S68ldJhrYI9gy8tZpcPsibRZmE5rDqMVaBs/gzMf1AsPA==',key_name='tempest-TestVolumeBootPattern-1852675789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-g17bb11f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:35:53Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=4cfcbac9-7014-48b4-a131-2c1b83838a4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:da:0e,bridge_name='br-int',has_traffic_filtering=True,id=d473651f-b160-4ae5-a077-6b0819e9cbcb,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd473651f-b1') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG nova.objects.instance [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cfcbac9-7014-48b4-a131-2c1b83838a4b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:36:11 user nova-compute[73012]:   <uuid>4cfcbac9-7014-48b4-a131-2c1b83838a4b</uuid>
Aug 14 12:36:11 user nova-compute[73012]:   <name>instance-0000002c</name>
Aug 14 12:36:11 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:36:11 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:36:11 user nova-compute[73012]:   <metadata>
Aug 14 12:36:11 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:36:11 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:36:11 user nova-compute[73012]:       <nova:name>tempest-TestVolumeBootPattern-server-95293580</nova:name>
Aug 14 12:36:11 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:36:10</nova:creationTime>
Aug 14 12:36:11 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:36:11 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:36:11 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:36:11 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:36:11 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:36:11 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:36:11 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:36:11 user nova-compute[73012]:       <nova:owner>
Aug 14 12:36:11 user nova-compute[73012]:         <nova:user uuid="0311f0fd37f143739604c409233537fa">tempest-TestVolumeBootPattern-1572075418-project-member</nova:user>
Aug 14 12:36:11 user nova-compute[73012]:         <nova:project uuid="7699b5c3fcc34a619e5d0d066e8ff642">tempest-TestVolumeBootPattern-1572075418</nova:project>
Aug 14 12:36:11 user nova-compute[73012]:       </nova:owner>
Aug 14 12:36:11 user nova-compute[73012]:       <nova:ports>
Aug 14 12:36:11 user nova-compute[73012]:         <nova:port uuid="d473651f-b160-4ae5-a077-6b0819e9cbcb">
Aug 14 12:36:11 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 12:36:11 user nova-compute[73012]:         </nova:port>
Aug 14 12:36:11 user nova-compute[73012]:       </nova:ports>
Aug 14 12:36:11 user nova-compute[73012]:     </nova:instance>
Aug 14 12:36:11 user nova-compute[73012]:   </metadata>
Aug 14 12:36:11 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:36:11 user nova-compute[73012]:     <system>
Aug 14 12:36:11 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:36:11 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:36:11 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:36:11 user nova-compute[73012]:       <entry name="serial">4cfcbac9-7014-48b4-a131-2c1b83838a4b</entry>
Aug 14 12:36:11 user nova-compute[73012]:       <entry name="uuid">4cfcbac9-7014-48b4-a131-2c1b83838a4b</entry>
Aug 14 12:36:11 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:36:11 user nova-compute[73012]:     </system>
Aug 14 12:36:11 user nova-compute[73012]:   </sysinfo>
Aug 14 12:36:11 user nova-compute[73012]:   <os>
Aug 14 12:36:11 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:36:11 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:36:11 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:36:11 user nova-compute[73012]:   </os>
Aug 14 12:36:11 user nova-compute[73012]:   <features>
Aug 14 12:36:11 user nova-compute[73012]:     <acpi/>
Aug 14 12:36:11 user nova-compute[73012]:     <apic/>
Aug 14 12:36:11 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:36:11 user nova-compute[73012]:   </features>
Aug 14 12:36:11 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:36:11 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:36:11 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:36:11 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:36:11 user nova-compute[73012]:   </clock>
Aug 14 12:36:11 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:36:11 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:36:11 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:36:11 user nova-compute[73012]:   </cpu>
Aug 14 12:36:11 user nova-compute[73012]:   <devices>
Aug 14 12:36:11 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:36:11 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:36:11 user nova-compute[73012]:       <source dev="/dev/sdb"/>
Aug 14 12:36:11 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:36:11 user nova-compute[73012]:       <serial>03cff6c0-a19c-4526-9143-3edac05caef2</serial>
Aug 14 12:36:11 user nova-compute[73012]:     </disk>
Aug 14 12:36:11 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:36:11 user nova-compute[73012]:       <mac address="fa:16:3e:5f:da:0e"/>
Aug 14 12:36:11 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:36:11 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:36:11 user nova-compute[73012]:       <target dev="tapd473651f-b1"/>
Aug 14 12:36:11 user nova-compute[73012]:     </interface>
Aug 14 12:36:11 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:36:11 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/4cfcbac9-7014-48b4-a131-2c1b83838a4b/console.log" append="off"/>
Aug 14 12:36:11 user nova-compute[73012]:     </serial>
Aug 14 12:36:11 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:36:11 user nova-compute[73012]:     <video>
Aug 14 12:36:11 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:36:11 user nova-compute[73012]:     </video>
Aug 14 12:36:11 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:36:11 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:36:11 user nova-compute[73012]:     </rng>
Aug 14 12:36:11 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:36:11 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:36:11 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:36:11 user nova-compute[73012]:     </memballoon>
Aug 14 12:36:11 user nova-compute[73012]:   </devices>
Aug 14 12:36:11 user nova-compute[73012]: </domain>
Aug 14 12:36:11 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-95293580',display_name='tempest-TestVolumeBootPattern-server-95293580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-95293580',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg7lN4gu0O9CJgDpyBhy0RX3jSYGXDmrd1kKjcONe+vy3hXe0gfOqavEjgU06+fs+8PvDAL8t8WC3udIvRk5S68ldJhrYI9gy8tZpcPsibRZmE5rDqMVaBs/gzMf1AsPA==',key_name='tempest-TestVolumeBootPattern-1852675789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-g17bb11f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:35:53Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=4cfcbac9-7014-48b4-a131-2c1b83838a4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:da:0e,bridge_name='br-int',has_traffic_filtering=True,id=d473651f-b160-4ae5-a077-6b0819e9cbcb,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd473651f-b1') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG os_vif [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:da:0e,bridge_name='br-int',has_traffic_filtering=True,id=d473651f-b160-4ae5-a077-6b0819e9cbcb,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd473651f-b1') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd473651f-b1, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd473651f-b1, col_values=(('external_ids', {'iface-id': 'd473651f-b160-4ae5-a077-6b0819e9cbcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:da:0e', 'vm-uuid': '4cfcbac9-7014-48b4-a131-2c1b83838a4b'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:36:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:11 user nova-compute[73012]: INFO os_vif [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:da:0e,bridge_name='br-int',has_traffic_filtering=True,id=d473651f-b160-4ae5-a077-6b0819e9cbcb,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd473651f-b1')
Aug 14 12:36:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:36:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No VIF found with MAC fa:16:3e:5f:da:0e, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-42d6bb52-61f0-4a3d-98b0-09d2ebeba6a1 req-1444f80a-324e-4eb4-be85-4f25e5e3c50f service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received event network-vif-plugged-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-42d6bb52-61f0-4a3d-98b0-09d2ebeba6a1 req-1444f80a-324e-4eb4-be85-4f25e5e3c50f service nova] Acquiring lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-42d6bb52-61f0-4a3d-98b0-09d2ebeba6a1 req-1444f80a-324e-4eb4-be85-4f25e5e3c50f service nova] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-42d6bb52-61f0-4a3d-98b0-09d2ebeba6a1 req-1444f80a-324e-4eb4-be85-4f25e5e3c50f service nova] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-42d6bb52-61f0-4a3d-98b0-09d2ebeba6a1 req-1444f80a-324e-4eb4-be85-4f25e5e3c50f service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] No waiting events found dispatching network-vif-plugged-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:36:13 user nova-compute[73012]: WARNING nova.compute.manager [req-42d6bb52-61f0-4a3d-98b0-09d2ebeba6a1 req-1444f80a-324e-4eb4-be85-4f25e5e3c50f service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received unexpected event network-vif-plugged-d473651f-b160-4ae5-a077-6b0819e9cbcb for instance with vm_state building and task_state spawning.
Aug 14 12:36:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016575.5662892, 4cfcbac9-7014-48b4-a131-2c1b83838a4b => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:36:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] VM Resumed (Lifecycle Event)
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:36:15 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Instance spawned successfully.
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:36:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016575.569792, 4cfcbac9-7014-48b4-a131-2c1b83838a4b => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:36:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] VM Started (Lifecycle Event)
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-0c40370f-a30d-4d01-a64d-e855e95cd01b req-658ce989-dbe9-40c0-bfa8-f28c1534726c service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received event network-vif-plugged-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0c40370f-a30d-4d01-a64d-e855e95cd01b req-658ce989-dbe9-40c0-bfa8-f28c1534726c service nova] Acquiring lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0c40370f-a30d-4d01-a64d-e855e95cd01b req-658ce989-dbe9-40c0-bfa8-f28c1534726c service nova] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0c40370f-a30d-4d01-a64d-e855e95cd01b req-658ce989-dbe9-40c0-bfa8-f28c1534726c service nova] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-0c40370f-a30d-4d01-a64d-e855e95cd01b req-658ce989-dbe9-40c0-bfa8-f28c1534726c service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] No waiting events found dispatching network-vif-plugged-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:36:15 user nova-compute[73012]: WARNING nova.compute.manager [req-0c40370f-a30d-4d01-a64d-e855e95cd01b req-658ce989-dbe9-40c0-bfa8-f28c1534726c service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received unexpected event network-vif-plugged-d473651f-b160-4ae5-a077-6b0819e9cbcb for instance with vm_state building and task_state spawning.
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:36:15 user nova-compute[73012]: INFO nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Took 5.25 seconds to spawn the instance on the hypervisor.
Aug 14 12:36:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:36:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:36:15 user nova-compute[73012]: INFO nova.compute.manager [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Took 23.59 seconds to build instance.
Aug 14 12:36:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-90013066-7a6b-400d-83af-40199adbeda8 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.019s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquiring lock "39ee4a24-3552-446e-a30b-24999e857044" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "39ee4a24-3552-446e-a30b-24999e857044" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquiring lock "39ee4a24-3552-446e-a30b-24999e857044-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:20 user nova-compute[73012]: INFO nova.compute.manager [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Terminating instance
Aug 14 12:36:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:36:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG nova.compute.manager [req-eedc34ae-d2fa-4fc6-a2fb-7ea62b2eae9a req-e34c5d18-93c4-4fe5-a974-b35fc7c5de57 service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received event network-vif-unplugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-eedc34ae-d2fa-4fc6-a2fb-7ea62b2eae9a req-e34c5d18-93c4-4fe5-a974-b35fc7c5de57 service nova] Acquiring lock "39ee4a24-3552-446e-a30b-24999e857044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-eedc34ae-d2fa-4fc6-a2fb-7ea62b2eae9a req-e34c5d18-93c4-4fe5-a974-b35fc7c5de57 service nova] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-eedc34ae-d2fa-4fc6-a2fb-7ea62b2eae9a req-e34c5d18-93c4-4fe5-a974-b35fc7c5de57 service nova] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG nova.compute.manager [req-eedc34ae-d2fa-4fc6-a2fb-7ea62b2eae9a req-e34c5d18-93c4-4fe5-a974-b35fc7c5de57 service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] No waiting events found dispatching network-vif-unplugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG nova.compute.manager [req-eedc34ae-d2fa-4fc6-a2fb-7ea62b2eae9a req-e34c5d18-93c4-4fe5-a974-b35fc7c5de57 service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received event network-vif-unplugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:36:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Instance destroyed successfully.
Aug 14 12:36:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lazy-loading 'resources' on Instance uuid 39ee4a24-3552-446e-a30b-24999e857044 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1754615478',display_name='tempest-VolumesNegativeTest-instance-1754615478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1754615478',id=43,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:34:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bab0b873b7df4a0fa5b8f6e64bf445ab',ramdisk_id='',reservation_id='r-0212aurt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1034914460',owner_user_name='tempest-VolumesNegativeTest-1034914460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:34:37Z,user_data=None,user_id='3c027a2d42444181916a2503b63ef723',uuid=39ee4a24-3552-446e-a30b-24999e857044,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Converting VIF {"id": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "address": "fa:16:3e:b6:70:f0", "network": {"id": "6c1092ef-335b-4c66-9878-d4f5120aaee9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e880c854ecce45f797f2a36534273c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bd3627-86", "ovs_interfaceid": "b2bd3627-8688-410a-8aec-0a8ea49db7f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:70:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2bd3627-8688-410a-8aec-0a8ea49db7f7,network=Network(6c1092ef-335b-4c66-9878-d4f5120aaee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bd3627-86') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG os_vif [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:70:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2bd3627-8688-410a-8aec-0a8ea49db7f7,network=Network(6c1092ef-335b-4c66-9878-d4f5120aaee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bd3627-86') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2bd3627-86, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:36:21 user nova-compute[73012]: INFO os_vif [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:70:f0,bridge_name='br-int',has_traffic_filtering=True,id=b2bd3627-8688-410a-8aec-0a8ea49db7f7,network=Network(6c1092ef-335b-4c66-9878-d4f5120aaee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bd3627-86')
Aug 14 12:36:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Deleting instance files /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044_del
Aug 14 12:36:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Deletion of /opt/stack/data/nova/instances/39ee4a24-3552-446e-a30b-24999e857044_del complete
Aug 14 12:36:21 user nova-compute[73012]: INFO nova.compute.manager [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 12:36:21 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:36:21 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 39ee4a24-3552-446e-a30b-24999e857044] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:36:22 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:36:22 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Took 0.55 seconds to deallocate network for instance.
Aug 14 12:36:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:22 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:36:22 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:36:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:22 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Deleted allocations for instance 39ee4a24-3552-446e-a30b-24999e857044
Aug 14 12:36:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ad9cd31-0aea-4c81-a7d3-8e272fd14235 tempest-VolumesNegativeTest-1034914460 tempest-VolumesNegativeTest-1034914460-project-member] Lock "39ee4a24-3552-446e-a30b-24999e857044" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.825s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-12234d60-8108-4517-87a7-812538212889 req-e7f6ac2c-f316-4147-9d5c-2c5dc343327b service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received event network-vif-plugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:36:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12234d60-8108-4517-87a7-812538212889 req-e7f6ac2c-f316-4147-9d5c-2c5dc343327b service nova] Acquiring lock "39ee4a24-3552-446e-a30b-24999e857044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12234d60-8108-4517-87a7-812538212889 req-e7f6ac2c-f316-4147-9d5c-2c5dc343327b service nova] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-12234d60-8108-4517-87a7-812538212889 req-e7f6ac2c-f316-4147-9d5c-2c5dc343327b service nova] Lock "39ee4a24-3552-446e-a30b-24999e857044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-12234d60-8108-4517-87a7-812538212889 req-e7f6ac2c-f316-4147-9d5c-2c5dc343327b service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] No waiting events found dispatching network-vif-plugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:36:23 user nova-compute[73012]: WARNING nova.compute.manager [req-12234d60-8108-4517-87a7-812538212889 req-e7f6ac2c-f316-4147-9d5c-2c5dc343327b service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received unexpected event network-vif-plugged-b2bd3627-8688-410a-8aec-0a8ea49db7f7 for instance with vm_state deleted and task_state None.
Aug 14 12:36:23 user nova-compute[73012]: DEBUG nova.compute.manager [req-12234d60-8108-4517-87a7-812538212889 req-e7f6ac2c-f316-4147-9d5c-2c5dc343327b service nova] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Received event network-vif-deleted-b2bd3627-8688-410a-8aec-0a8ea49db7f7 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOszrau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:36:24 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:36:24 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:36:24 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fbc4af-9f14-470b-b47a-d897c9028ca3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:36:24 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ab2258-e809-43b2-a1f7-5cce3b9d3e6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded] added
Aug 14 12:36:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f5eb8f-9148-42ec-bd8a-46ddcdb72a75]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9209a3c-7245-4e1d-b122-b1bd487f53a5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjOszrau {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjOszrau" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6339f0-6007-4432-a492-2dc5fbee04a5]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xjOszrau'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d95484-58af-44fe-b112-14e4952b9b96]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca37d54-5629-4f16-8b0f-5925256495ae]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:24 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:36:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:24 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:36:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6560b6d7-dc19-4384-85a3-a50a1ae9865a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded, portal: 172.16.0.220,3260]
Aug 14 12:36:24 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded, portal: 172.16.0.220,3260] successful.
Aug 14 12:36:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9300599a-0299-4c22-a0a4-7cbeb19851ad]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f086869-1151-48bd-a6a2-b40ded044e4c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:24 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:36:24 user nova-compute[73012]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded (non-flash)
Aug 14 12:36:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:24 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:36:24 user nova-compute[73012]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded (non-flash)
Aug 14 12:36:24 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e3aca7-b10b-4f57-be4c-440b50fa83ba]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:36:24 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOszrau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:36:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:36:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23963333263333838', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:36:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963333263333838', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:36:25 user nova-compute[73012]: DEBUG nova.objects.instance [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'flavor' on Instance uuid 4f892efc-9623-4dff-b540-291c55639499 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:36:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:36:26 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:36:26 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:36:26 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:36:26 user nova-compute[73012]:   <serial>cec1dc50-ad95-4b44-bd9c-2fb441e52ded</serial>
Aug 14 12:36:26 user nova-compute[73012]: </disk>
Aug 14 12:36:26 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:36:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:36:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:36:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No VIF found with MAC fa:16:3e:d2:28:aa, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:36:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-468cd5c6-797d-4f9c-aaf6-f1fef1bc0c1e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.111s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:28 user nova-compute[73012]: INFO nova.compute.manager [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Detaching volume cec1dc50-ad95-4b44-bd9c-2fb441e52ded
Aug 14 12:36:28 user nova-compute[73012]: INFO nova.virt.block_device [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Attempting to driver detach volume cec1dc50-ad95-4b44-bd9c-2fb441e52ded from mountpoint /dev/vdb
Aug 14 12:36:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Attempting to detach device vdb from instance 4f892efc-9623-4dff-b540-291c55639499 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:36:28 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:36:28 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:36:28 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:36:28 user nova-compute[73012]:   <serial>cec1dc50-ad95-4b44-bd9c-2fb441e52ded</serial>
Aug 14 12:36:28 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:36:28 user nova-compute[73012]: </disk>
Aug 14 12:36:28 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:36:28 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully detached device vdb from instance 4f892efc-9623-4dff-b540-291c55639499 from the persistent domain config.
Aug 14 12:36:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f892efc-9623-4dff-b540-291c55639499 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:36:28 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:36:28 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:36:28 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:36:28 user nova-compute[73012]:   <serial>cec1dc50-ad95-4b44-bd9c-2fb441e52ded</serial>
Aug 14 12:36:28 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:36:28 user nova-compute[73012]: </disk>
Aug 14 12:36:28 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692016588.7215934, 4f892efc-9623-4dff-b540-291c55639499 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f892efc-9623-4dff-b540-291c55639499 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:36:28 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully detached device vdb from instance 4f892efc-9623-4dff-b540-291c55639499 from the live domain config.
Aug 14 12:36:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOszrau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:36:28 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ff6ebb-471a-4a36-a6b7-a7b320b41b80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaba1ba-46dd-4468-8109-e4dfaf4e7729]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:28 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:36:28 user nova-compute[73012]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded (non-flash)
Aug 14 12:36:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:36:28 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:36:28 user nova-compute[73012]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded (non-flash)
Aug 14 12:36:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0149120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffb714d-2bb1-4c6d-8f42-09e1332a3463]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c632dca-5368-4b5e-9746-35366d6bdc88]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9061695b-5877-44f6-81f2-ee2582884f9b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96c4e25-6ece-4c33-8357-191f0548a365]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b299753-6961-4635-bbe9-8743161b7678]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c884d4-e2c2-4a11-9a68-3e5fa5f2cd8b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded, portal: 172.16.0.220,3260]
Aug 14 12:36:28 user nova-compute[73012]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded, portal: 172.16.0.220,3260] successful.
Aug 14 12:36:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cec1dc50-ad95-4b44-bd9c-2fb441e52ded -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:29 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f074053c-3329-41eb-a4ef-9b1be42bf566]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:36:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:36:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:36:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] <== disconnect_volume: return (272ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:36:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:36:29 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'flavor' on Instance uuid 4f892efc-9623-4dff-b540-291c55639499 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:36:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c127cbfd-51a5-407b-8e31-4f599566d392 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.677s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:36 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016581.5734632, 39ee4a24-3552-446e-a30b-24999e857044 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:36:36 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 39ee4a24-3552-446e-a30b-24999e857044] VM Stopped (Lifecycle Event)
Aug 14 12:36:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-08d9ec58-e65c-4240-92d0-676c50435192 None None] [instance: 39ee4a24-3552-446e-a30b-24999e857044] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:36:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:51 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:36:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:36:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:36:52 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:36:52 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:36:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=25.384521484375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:36:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:36:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4f892efc-9623-4dff-b540-291c55639499 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4cfcbac9-7014-48b4-a131-2c1b83838a4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:36:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:36:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:36:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:36:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:36:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:36:55 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] Updating instance_info_cache with network_info: [{"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:36:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-4f892efc-9623-4dff-b540-291c55639499" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:36:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:36:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:56 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:36:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:36:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:36:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:37:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:04 user nova-compute[73012]: INFO nova.compute.manager [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Terminating instance
Aug 14 12:37:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:37:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-73199273-4127-45cd-9eb9-639f36c7c3ea req-b7ec2efc-e238-46db-8e3e-7facd92b2137 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-73199273-4127-45cd-9eb9-639f36c7c3ea req-b7ec2efc-e238-46db-8e3e-7facd92b2137 service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-73199273-4127-45cd-9eb9-639f36c7c3ea req-b7ec2efc-e238-46db-8e3e-7facd92b2137 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-73199273-4127-45cd-9eb9-639f36c7c3ea req-b7ec2efc-e238-46db-8e3e-7facd92b2137 service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-73199273-4127-45cd-9eb9-639f36c7c3ea req-b7ec2efc-e238-46db-8e3e-7facd92b2137 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-73199273-4127-45cd-9eb9-639f36c7c3ea req-b7ec2efc-e238-46db-8e3e-7facd92b2137 service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:05 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Instance destroyed successfully.
Aug 14 12:37:05 user nova-compute[73012]: DEBUG nova.objects.instance [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lazy-loading 'resources' on Instance uuid 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-683919669',display_name='tempest-ServerActionsTestOtherB-server-683919669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-683919669',id=37,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVjrJiYPu6VYHnut5LdA0Riwd5ahrXlC4jKtuzbgu4gaPK7GwJ6AlbseM7ClHweAl3Etw8IhYAGZR1UXBZkzmwzGLDvStrigStIDDCoqd0aV5jAHV9FbuiI+5NM0Xr4Q==',key_name='tempest-keypair-284235109',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:34:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a071f634fe4f46aaab5408abc931ac4b',ramdisk_id='',reservation_id='r-70vm0iqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-539296427',owner_user_name='tempest-ServerActionsTestOtherB-539296427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84931e0fc1e64b1fb176f88e0a5fffb9',uuid=6c72a6b0-188c-486a-b6c8-4f2c0d2ae371,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converting VIF {"id": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "address": "fa:16:3e:88:d7:00", "network": {"id": "c4cf3cb5-9b13-42a8-96af-5f1125953555", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-788792913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a071f634fe4f46aaab5408abc931ac4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec9f44-ed", "ovs_interfaceid": "29ec9f44-ed38-45b5-bafe-41aff2453e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_vif [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29ec9f44-ed, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:37:05 user nova-compute[73012]: INFO os_vif [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d7:00,bridge_name='br-int',has_traffic_filtering=True,id=29ec9f44-ed38-45b5-bafe-41aff2453e83,network=Network(c4cf3cb5-9b13-42a8-96af-5f1125953555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec9f44-ed')
Aug 14 12:37:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEkDudnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:37:05 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00a49ad-dc33-4326-9aad-eccfc53c04b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc5a0be-c39c-4aac-810c-555a1cd20903]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:37:05 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:37:05 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 (non-flash)
Aug 14 12:37:05 user nova-compute[73012]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:37:05 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0148dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2580e49-f6f9-43f8-a7ac-1a590c09d0ec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b179eb8-c000-48ea-b3a2-347212fb4a1b]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24666ee-eb69-42e2-8e85-b2a72119f29c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[378cd939-03a6-4667-aedb-89f901ca245f]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6868d978-609f-45f1-ad60-ef27de792391]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bd807c-91a3-4a11-9572-bdf71b176922]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260]
Aug 14 12:37:05 user nova-compute[73012]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136, portal: 172.16.0.220,3260] successful.
Aug 14 12:37:05 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46290eca-8586-4527-bf66-4d04f8176136 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ef0080-f13a-4cd4-8f4a-e3e6377b043c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] <== disconnect_volume: return (300ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:37:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:37:05 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Deleting instance files /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371_del
Aug 14 12:37:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Deletion of /opt/stack/data/nova/instances/6c72a6b0-188c-486a-b6c8-4f2c0d2ae371_del complete
Aug 14 12:37:06 user nova-compute[73012]: INFO nova.compute.manager [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 14 12:37:06 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:37:06 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:37:06 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:37:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:37:07 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Took 1.05 seconds to deallocate network for instance.
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:07 user nova-compute[73012]: WARNING nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state deleting.
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:07 user nova-compute[73012]: WARNING nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state deleting.
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:07 user nova-compute[73012]: WARNING nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state deleting.
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-unplugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Acquiring lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] No waiting events found dispatching network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:07 user nova-compute[73012]: WARNING nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received unexpected event network-vif-plugged-29ec9f44-ed38-45b5-bafe-41aff2453e83 for instance with vm_state active and task_state deleting.
Aug 14 12:37:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-87ca930e-0f2e-41dd-a965-bc986fb77df4 req-0a8619fc-cb63-46ca-be98-f6d03cd54d5a service nova] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Received event network-vif-deleted-29ec9f44-ed38-45b5-bafe-41aff2453e83 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:07 user nova-compute[73012]: INFO nova.compute.manager [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Took 0.79 seconds to detach 1 volumes for instance.
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:08 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:37:08 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:37:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:08 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Deleted allocations for instance 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371
Aug 14 12:37:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5c2e0d9b-238b-492a-87c8-04bbf1eac466 tempest-ServerActionsTestOtherB-539296427 tempest-ServerActionsTestOtherB-539296427-project-member] Lock "6c72a6b0-188c-486a-b6c8-4f2c0d2ae371" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.387s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:37:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:37:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:37:16 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:18 user nova-compute[73012]: INFO nova.compute.manager [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Terminating instance
Aug 14 12:37:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-c2ea07ca-d0d3-42ae-a3da-391b7521d60e req-9e17b852-5e01-4084-9d9a-86d3a0605c6c service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received event network-vif-unplugged-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c2ea07ca-d0d3-42ae-a3da-391b7521d60e req-9e17b852-5e01-4084-9d9a-86d3a0605c6c service nova] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c2ea07ca-d0d3-42ae-a3da-391b7521d60e req-9e17b852-5e01-4084-9d9a-86d3a0605c6c service nova] Lock "4f892efc-9623-4dff-b540-291c55639499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c2ea07ca-d0d3-42ae-a3da-391b7521d60e req-9e17b852-5e01-4084-9d9a-86d3a0605c6c service nova] Lock "4f892efc-9623-4dff-b540-291c55639499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-c2ea07ca-d0d3-42ae-a3da-391b7521d60e req-9e17b852-5e01-4084-9d9a-86d3a0605c6c service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] No waiting events found dispatching network-vif-unplugged-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-c2ea07ca-d0d3-42ae-a3da-391b7521d60e req-9e17b852-5e01-4084-9d9a-86d3a0605c6c service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received event network-vif-unplugged-2a969928-5934-417f-b66e-7a61c0946c3a for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:19 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4f892efc-9623-4dff-b540-291c55639499] Instance destroyed successfully.
Aug 14 12:37:19 user nova-compute[73012]: DEBUG nova.objects.instance [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'resources' on Instance uuid 4f892efc-9623-4dff-b540-291c55639499 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2026622822',display_name='tempest-AttachVolumeNegativeTest-server-2026622822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2026622822',id=42,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL187sl9LBt/6lAy2MwftUu7NVFLrlKFY9BaN6oMzXVl+F13GNqEjQxosSDf37Mpt5eA4oToLgaMVUH1X9MGdz1JALeuOBbE4S4uHi3hM5Sc13SrHJ/pJgwF3kuloTI1dw==',key_name='tempest-keypair-202284652',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-kufkoug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:34:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=4f892efc-9623-4dff-b540-291c55639499,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "2a969928-5934-417f-b66e-7a61c0946c3a", "address": "fa:16:3e:d2:28:aa", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a969928-59", "ovs_interfaceid": "2a969928-5934-417f-b66e-7a61c0946c3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:28:aa,bridge_name='br-int',has_traffic_filtering=True,id=2a969928-5934-417f-b66e-7a61c0946c3a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a969928-59') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG os_vif [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:28:aa,bridge_name='br-int',has_traffic_filtering=True,id=2a969928-5934-417f-b66e-7a61c0946c3a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a969928-59') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a969928-59, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:19 user nova-compute[73012]: INFO os_vif [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:28:aa,bridge_name='br-int',has_traffic_filtering=True,id=2a969928-5934-417f-b66e-7a61c0946c3a,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a969928-59')
Aug 14 12:37:19 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Deleting instance files /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499_del
Aug 14 12:37:19 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Deletion of /opt/stack/data/nova/instances/4f892efc-9623-4dff-b540-291c55639499_del complete
Aug 14 12:37:19 user nova-compute[73012]: INFO nova.compute.manager [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: 4f892efc-9623-4dff-b540-291c55639499] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 12:37:19 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 4f892efc-9623-4dff-b540-291c55639499] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:37:19 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 4f892efc-9623-4dff-b540-291c55639499] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 4f892efc-9623-4dff-b540-291c55639499] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:37:20 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 4f892efc-9623-4dff-b540-291c55639499] Took 0.87 seconds to deallocate network for instance.
Aug 14 12:37:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:20 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Deleted allocations for instance 4f892efc-9623-4dff-b540-291c55639499
Aug 14 12:37:20 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016625.6490233, 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:37:20 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] VM Stopped (Lifecycle Event)
Aug 14 12:37:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1a4c5b02-3293-4a24-b083-24f80f32c6da tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "4f892efc-9623-4dff-b540-291c55639499" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.132s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-98576bb5-ec75-434f-8f0a-ba1f918e71f1 None None] [instance: 6c72a6b0-188c-486a-b6c8-4f2c0d2ae371] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-25a5aa7d-75c2-4744-ab2a-26b14318c0fb req-768777b1-248b-4720-a063-af83beffbd18 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received event network-vif-plugged-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-25a5aa7d-75c2-4744-ab2a-26b14318c0fb req-768777b1-248b-4720-a063-af83beffbd18 service nova] Acquiring lock "4f892efc-9623-4dff-b540-291c55639499-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-25a5aa7d-75c2-4744-ab2a-26b14318c0fb req-768777b1-248b-4720-a063-af83beffbd18 service nova] Lock "4f892efc-9623-4dff-b540-291c55639499-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-25a5aa7d-75c2-4744-ab2a-26b14318c0fb req-768777b1-248b-4720-a063-af83beffbd18 service nova] Lock "4f892efc-9623-4dff-b540-291c55639499-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-25a5aa7d-75c2-4744-ab2a-26b14318c0fb req-768777b1-248b-4720-a063-af83beffbd18 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] No waiting events found dispatching network-vif-plugged-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:20 user nova-compute[73012]: WARNING nova.compute.manager [req-25a5aa7d-75c2-4744-ab2a-26b14318c0fb req-768777b1-248b-4720-a063-af83beffbd18 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received unexpected event network-vif-plugged-2a969928-5934-417f-b66e-7a61c0946c3a for instance with vm_state deleted and task_state None.
Aug 14 12:37:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-25a5aa7d-75c2-4744-ab2a-26b14318c0fb req-768777b1-248b-4720-a063-af83beffbd18 service nova] [instance: 4f892efc-9623-4dff-b540-291c55639499] Received event network-vif-deleted-2a969928-5934-417f-b66e-7a61c0946c3a {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:34 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016639.2864296, 4f892efc-9623-4dff-b540-291c55639499 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:37:34 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 4f892efc-9623-4dff-b540-291c55639499] VM Stopped (Lifecycle Event)
Aug 14 12:37:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9fbdc0af-a94b-42c8-82b0-b8b094d99824 None None] [instance: 4f892efc-9623-4dff-b540-291c55639499] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:37:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-bfb6986d-d809-43d7-a0cb-ba4adf7510d5 req-78b152b9-6061-4d69-a25a-13266d4246af service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received event network-changed-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-bfb6986d-d809-43d7-a0cb-ba4adf7510d5 req-78b152b9-6061-4d69-a25a-13266d4246af service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Refreshing instance network info cache due to event network-changed-d473651f-b160-4ae5-a077-6b0819e9cbcb. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:37:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bfb6986d-d809-43d7-a0cb-ba4adf7510d5 req-78b152b9-6061-4d69-a25a-13266d4246af service nova] Acquiring lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:37:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bfb6986d-d809-43d7-a0cb-ba4adf7510d5 req-78b152b9-6061-4d69-a25a-13266d4246af service nova] Acquired lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:37:43 user nova-compute[73012]: DEBUG nova.network.neutron [req-bfb6986d-d809-43d7-a0cb-ba4adf7510d5 req-78b152b9-6061-4d69-a25a-13266d4246af service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Refreshing network info cache for port d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:37:44 user nova-compute[73012]: INFO nova.compute.claims [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Claim successful on node user
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-bfb6986d-d809-43d7-a0cb-ba4adf7510d5 req-78b152b9-6061-4d69-a25a-13266d4246af service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updated VIF entry in instance network info cache for port d473651f-b160-4ae5-a077-6b0819e9cbcb. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-bfb6986d-d809-43d7-a0cb-ba4adf7510d5 req-78b152b9-6061-4d69-a25a-13266d4246af service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updating instance_info_cache with network_info: [{"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-bfb6986d-d809-43d7-a0cb-ba4adf7510d5 req-78b152b9-6061-4d69-a25a-13266d4246af service nova] Releasing lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:37:44 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.policy [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7feaad28b32a4769acbbc87598f0da59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab505f398334cd695ac16793ab4b7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:37:44 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Creating image(s)
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "/opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "/opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "/opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk 1073741824" returned: 0 in 0.054s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.218s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Cannot resize image /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'migration_context' on Instance uuid 0748d973-3d1f-4197-b850-4cf6b5ab23b4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Ensure instance console log exists: /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:45 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Successfully created port: fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:37:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:46 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Successfully updated port: fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:37:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:37:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquired lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:37:46 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-46721c94-d2b6-4911-9e3d-9c92a460153a req-bcab963a-46f3-4778-a5ea-90adfec174ac service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received event network-changed-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.compute.manager [req-46721c94-d2b6-4911-9e3d-9c92a460153a req-bcab963a-46f3-4778-a5ea-90adfec174ac service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Refreshing instance network info cache due to event network-changed-fd3ce9bb-890e-49d5-86d2-63a74da9b54d. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-46721c94-d2b6-4911-9e3d-9c92a460153a req-bcab963a-46f3-4778-a5ea-90adfec174ac service nova] Acquiring lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.network.neutron [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Updating instance_info_cache with network_info: [{"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Releasing lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Instance network_info: |[{"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-46721c94-d2b6-4911-9e3d-9c92a460153a req-bcab963a-46f3-4778-a5ea-90adfec174ac service nova] Acquired lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.network.neutron [req-46721c94-d2b6-4911-9e3d-9c92a460153a req-bcab963a-46f3-4778-a5ea-90adfec174ac service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Refreshing network info cache for port fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Start _get_guest_xml network_info=[{"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:37:47 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:37:47 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:37:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1361413395',display_name='tempest-VolumesSnapshotTestJSON-instance-1361413395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1361413395',id=45,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3nsdvplYJspUvoSunyIxuQP/2r+TCzWptVLygFrnDvDpU6GB1Cj6EtPQDCCZv+WUZodeWA17255o1QF2NUhjxZArZ3ySRTmoqt63YZqNujK0NLwum6vZ872gAFkFWblQ==',key_name='tempest-keypair-2078311329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ab505f398334cd695ac16793ab4b7c9',ramdisk_id='',reservation_id='r-cht27ck1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1686077578',owner_user_name='tempest-VolumesSnapshotTestJSON-1686077578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feaad28b32a4769acbbc87598f0da59',uuid=0748d973-3d1f-4197-b850-4cf6b5ab23b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converting VIF {"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=fd3ce9bb-890e-49d5-86d2-63a74da9b54d,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd3ce9bb-89') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.objects.instance [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'pci_devices' on Instance uuid 0748d973-3d1f-4197-b850-4cf6b5ab23b4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:37:47 user nova-compute[73012]:   <uuid>0748d973-3d1f-4197-b850-4cf6b5ab23b4</uuid>
Aug 14 12:37:47 user nova-compute[73012]:   <name>instance-0000002d</name>
Aug 14 12:37:47 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:37:47 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:37:47 user nova-compute[73012]:   <metadata>
Aug 14 12:37:47 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:37:47 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:37:47 user nova-compute[73012]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1361413395</nova:name>
Aug 14 12:37:47 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:37:47</nova:creationTime>
Aug 14 12:37:47 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:37:47 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:37:47 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:37:47 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:37:47 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:37:47 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:37:47 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:37:47 user nova-compute[73012]:       <nova:owner>
Aug 14 12:37:47 user nova-compute[73012]:         <nova:user uuid="7feaad28b32a4769acbbc87598f0da59">tempest-VolumesSnapshotTestJSON-1686077578-project-member</nova:user>
Aug 14 12:37:47 user nova-compute[73012]:         <nova:project uuid="1ab505f398334cd695ac16793ab4b7c9">tempest-VolumesSnapshotTestJSON-1686077578</nova:project>
Aug 14 12:37:47 user nova-compute[73012]:       </nova:owner>
Aug 14 12:37:47 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:37:47 user nova-compute[73012]:       <nova:ports>
Aug 14 12:37:47 user nova-compute[73012]:         <nova:port uuid="fd3ce9bb-890e-49d5-86d2-63a74da9b54d">
Aug 14 12:37:47 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 12:37:47 user nova-compute[73012]:         </nova:port>
Aug 14 12:37:47 user nova-compute[73012]:       </nova:ports>
Aug 14 12:37:47 user nova-compute[73012]:     </nova:instance>
Aug 14 12:37:47 user nova-compute[73012]:   </metadata>
Aug 14 12:37:47 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:37:47 user nova-compute[73012]:     <system>
Aug 14 12:37:47 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:37:47 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:37:47 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:37:47 user nova-compute[73012]:       <entry name="serial">0748d973-3d1f-4197-b850-4cf6b5ab23b4</entry>
Aug 14 12:37:47 user nova-compute[73012]:       <entry name="uuid">0748d973-3d1f-4197-b850-4cf6b5ab23b4</entry>
Aug 14 12:37:47 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:37:47 user nova-compute[73012]:     </system>
Aug 14 12:37:47 user nova-compute[73012]:   </sysinfo>
Aug 14 12:37:47 user nova-compute[73012]:   <os>
Aug 14 12:37:47 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:37:47 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:37:47 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:37:47 user nova-compute[73012]:   </os>
Aug 14 12:37:47 user nova-compute[73012]:   <features>
Aug 14 12:37:47 user nova-compute[73012]:     <acpi/>
Aug 14 12:37:47 user nova-compute[73012]:     <apic/>
Aug 14 12:37:47 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:37:47 user nova-compute[73012]:   </features>
Aug 14 12:37:47 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:37:47 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:37:47 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:37:47 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:37:47 user nova-compute[73012]:   </clock>
Aug 14 12:37:47 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:37:47 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:37:47 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:37:47 user nova-compute[73012]:   </cpu>
Aug 14 12:37:47 user nova-compute[73012]:   <devices>
Aug 14 12:37:47 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:37:47 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:37:47 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk"/>
Aug 14 12:37:47 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:37:47 user nova-compute[73012]:     </disk>
Aug 14 12:37:47 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:37:47 user nova-compute[73012]:       <mac address="fa:16:3e:33:fb:4b"/>
Aug 14 12:37:47 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:37:47 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:37:47 user nova-compute[73012]:       <target dev="tapfd3ce9bb-89"/>
Aug 14 12:37:47 user nova-compute[73012]:     </interface>
Aug 14 12:37:47 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:37:47 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/console.log" append="off"/>
Aug 14 12:37:47 user nova-compute[73012]:     </serial>
Aug 14 12:37:47 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:37:47 user nova-compute[73012]:     <video>
Aug 14 12:37:47 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:37:47 user nova-compute[73012]:     </video>
Aug 14 12:37:47 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:37:47 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:37:47 user nova-compute[73012]:     </rng>
Aug 14 12:37:47 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:37:47 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:37:47 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:37:47 user nova-compute[73012]:     </memballoon>
Aug 14 12:37:47 user nova-compute[73012]:   </devices>
Aug 14 12:37:47 user nova-compute[73012]: </domain>
Aug 14 12:37:47 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:37:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1361413395',display_name='tempest-VolumesSnapshotTestJSON-instance-1361413395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1361413395',id=45,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3nsdvplYJspUvoSunyIxuQP/2r+TCzWptVLygFrnDvDpU6GB1Cj6EtPQDCCZv+WUZodeWA17255o1QF2NUhjxZArZ3ySRTmoqt63YZqNujK0NLwum6vZ872gAFkFWblQ==',key_name='tempest-keypair-2078311329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ab505f398334cd695ac16793ab4b7c9',ramdisk_id='',reservation_id='r-cht27ck1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1686077578',owner_user_name='tempest-VolumesSnapshotTestJSON-1686077578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feaad28b32a4769acbbc87598f0da59',uuid=0748d973-3d1f-4197-b850-4cf6b5ab23b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converting VIF {"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=fd3ce9bb-890e-49d5-86d2-63a74da9b54d,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd3ce9bb-89') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG os_vif [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=fd3ce9bb-890e-49d5-86d2-63a74da9b54d,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd3ce9bb-89') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd3ce9bb-89, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd3ce9bb-89, col_values=(('external_ids', {'iface-id': 'fd3ce9bb-890e-49d5-86d2-63a74da9b54d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:fb:4b', 'vm-uuid': '0748d973-3d1f-4197-b850-4cf6b5ab23b4'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:47 user nova-compute[73012]: INFO os_vif [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=fd3ce9bb-890e-49d5-86d2-63a74da9b54d,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd3ce9bb-89')
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No VIF found with MAC fa:16:3e:33:fb:4b, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.network.neutron [req-46721c94-d2b6-4911-9e3d-9c92a460153a req-bcab963a-46f3-4778-a5ea-90adfec174ac service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Updated VIF entry in instance network info cache for port fd3ce9bb-890e-49d5-86d2-63a74da9b54d. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG nova.network.neutron [req-46721c94-d2b6-4911-9e3d-9c92a460153a req-bcab963a-46f3-4778-a5ea-90adfec174ac service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Updating instance_info_cache with network_info: [{"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:37:47 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-46721c94-d2b6-4911-9e3d-9c92a460153a req-bcab963a-46f3-4778-a5ea-90adfec174ac service nova] Releasing lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:37:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:48 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-beb2c93c-db7c-421b-99e2-5b297d650cf2 req-b76b43ea-e93e-4530-b6ad-f4173ebf8060 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received event network-vif-plugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-beb2c93c-db7c-421b-99e2-5b297d650cf2 req-b76b43ea-e93e-4530-b6ad-f4173ebf8060 service nova] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-beb2c93c-db7c-421b-99e2-5b297d650cf2 req-b76b43ea-e93e-4530-b6ad-f4173ebf8060 service nova] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-beb2c93c-db7c-421b-99e2-5b297d650cf2 req-b76b43ea-e93e-4530-b6ad-f4173ebf8060 service nova] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-beb2c93c-db7c-421b-99e2-5b297d650cf2 req-b76b43ea-e93e-4530-b6ad-f4173ebf8060 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] No waiting events found dispatching network-vif-plugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:49 user nova-compute[73012]: WARNING nova.compute.manager [req-beb2c93c-db7c-421b-99e2-5b297d650cf2 req-b76b43ea-e93e-4530-b6ad-f4173ebf8060 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received unexpected event network-vif-plugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d for instance with vm_state building and task_state spawning.
Aug 14 12:37:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:50 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016670.9546337, 0748d973-3d1f-4197-b850-4cf6b5ab23b4 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:37:50 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] VM Resumed (Lifecycle Event)
Aug 14 12:37:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:37:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:37:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Instance spawned successfully.
Aug 14 12:37:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:37:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:37:50 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:37:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:37:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:37:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016670.9559085, 0748d973-3d1f-4197-b850-4cf6b5ab23b4 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:37:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] VM Started (Lifecycle Event)
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-6bb91d17-9491-4f5f-8e73-fd298369e7fb req-da4cc5ee-2923-4085-8bf4-29476347c2a4 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received event network-vif-plugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6bb91d17-9491-4f5f-8e73-fd298369e7fb req-da4cc5ee-2923-4085-8bf4-29476347c2a4 service nova] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6bb91d17-9491-4f5f-8e73-fd298369e7fb req-da4cc5ee-2923-4085-8bf4-29476347c2a4 service nova] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6bb91d17-9491-4f5f-8e73-fd298369e7fb req-da4cc5ee-2923-4085-8bf4-29476347c2a4 service nova] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-6bb91d17-9491-4f5f-8e73-fd298369e7fb req-da4cc5ee-2923-4085-8bf4-29476347c2a4 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] No waiting events found dispatching network-vif-plugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:37:51 user nova-compute[73012]: WARNING nova.compute.manager [req-6bb91d17-9491-4f5f-8e73-fd298369e7fb req-da4cc5ee-2923-4085-8bf4-29476347c2a4 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received unexpected event network-vif-plugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d for instance with vm_state building and task_state spawning.
Aug 14 12:37:51 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:37:51 user nova-compute[73012]: INFO nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Took 6.42 seconds to spawn the instance on the hypervisor.
Aug 14 12:37:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:37:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:51 user nova-compute[73012]: INFO nova.compute.manager [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Took 7.00 seconds to build instance.
Aug 14 12:37:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-d668c78c-2efc-4b04-8137-460660d66a5e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.144s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:53 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:37:53 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:37:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=25.436809539794922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4cfcbac9-7014-48b4-a131-2c1b83838a4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0748d973-3d1f-4197-b850-4cf6b5ab23b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:37:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:37:54 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:37:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:37:56 user nova-compute[73012]: INFO nova.compute.claims [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Claim successful on node user
Aug 14 12:37:56 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:37:56 user nova-compute[73012]: DEBUG nova.network.neutron [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:37:57 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:37:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:37:57 user nova-compute[73012]: INFO nova.virt.block_device [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Booting with volume 809d17d5-713b-4803-a08b-897b4f209142 at /dev/vda
Aug 14 12:37:57 user nova-compute[73012]: DEBUG nova.policy [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0311f0fd37f143739604c409233537fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7699b5c3fcc34a619e5d0d066e8ff642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG os_brick.utils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0263c161-57b8-4e73-aba8-34b25563ff78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c8f7a2-a00d-471a-9394-5ff8256d6b79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2af9c9-b056-445d-8e6d-cdd82846f5b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40d4922-55fc-470c-8b5f-98c5e0392af5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:37:57 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:37:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ae2679-9c7c-437e-b1e0-342dbab57125]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG os_brick.utils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Updating existing volume attachment record: 0c7c76fd-402b-48c9-837c-1c8c0dbd3619 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:37:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Successfully created port: e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG nova.network.neutron [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Successfully updated port: e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquired lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG nova.network.neutron [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f8fb9c6-8973-4a26-83aa-f6b9af456db3 req-948a3404-3a15-441d-8226-267d99505556 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received event network-changed-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-1f8fb9c6-8973-4a26-83aa-f6b9af456db3 req-948a3404-3a15-441d-8226-267d99505556 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Refreshing instance network info cache due to event network-changed-e7787e55-f462-4181-8fde-df929ec64ae6. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f8fb9c6-8973-4a26-83aa-f6b9af456db3 req-948a3404-3a15-441d-8226-267d99505556 service nova] Acquiring lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:37:58 user nova-compute[73012]: DEBUG nova.network.neutron [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:37:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Updating instance_info_cache with network_info: [{"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:37:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Releasing lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:37:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Instance network_info: |[{"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:37:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f8fb9c6-8973-4a26-83aa-f6b9af456db3 req-948a3404-3a15-441d-8226-267d99505556 service nova] Acquired lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:37:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-1f8fb9c6-8973-4a26-83aa-f6b9af456db3 req-948a3404-3a15-441d-8226-267d99505556 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Refreshing network info cache for port e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:37:59 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:37:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-1f8fb9c6-8973-4a26-83aa-f6b9af456db3 req-948a3404-3a15-441d-8226-267d99505556 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Updated VIF entry in instance network info cache for port e7787e55-f462-4181-8fde-df929ec64ae6. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:37:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-1f8fb9c6-8973-4a26-83aa-f6b9af456db3 req-948a3404-3a15-441d-8226-267d99505556 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Updating instance_info_cache with network_info: [{"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:37:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1f8fb9c6-8973-4a26-83aa-f6b9af456db3 req-948a3404-3a15-441d-8226-267d99505556 service nova] Releasing lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:38:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:38:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:38:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Creating image(s)
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Did not create local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Ensure instance console log exists: /opt/stack/data/nova/instances/cc5b695c-5e83-4476-b37a-93e7d59a73ff/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Start _get_guest_xml network_info=[{"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeGVXWCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc5b695c-5e83-4476-b37a-93e7d59a73ff', 'attached_at': '', 'detached_at': '', 'volume_id': '809d17d5-713b-4803-a08b-897b4f209142', 'serial': '809d17d5-713b-4803-a08b-897b4f209142'}, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '0c7c76fd-402b-48c9-837c-1c8c0dbd3619', 'volume_type': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:38:06 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:38:06 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeGVXWCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:38:06 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:38:06 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:38:06 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfc424a-2d27-4f8f-ae0f-fe15878a824d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:38:06 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5211170d-dc50-4fa8-8542-ba0144705d94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142] added
Aug 14 12:38:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d3d622-89be-4e24-b1f8-96c0c861ce84]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dbadcf-9bab-48d5-a56d-acf210051d31]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BeGVXWCM {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BeGVXWCM" returned: 0 in 0.073s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0da3253-ae85-4924-bd5f-1f4f9409ee98]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BeGVXWCM'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e65b960-b3ba-405a-9232-594915c0a6e0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a44994-6810-4efc-b53a-0c6fe7a2e96b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:38:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:38:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[85571ab7-b0fa-47cf-8445-9bbe5d5b3949]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142, portal: 172.16.0.220,3260]
Aug 14 12:38:06 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142, portal: 172.16.0.220,3260] successful.
Aug 14 12:38:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d325b-2a74-4a55-8f5e-565f21b82677]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[584e9c16-a3ae-4668-b079-5d06d901b2d0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:38:06 user nova-compute[73012]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)
Aug 14 12:38:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:38:06 user nova-compute[73012]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)
Aug 14 12:38:06 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b70754-9206-45d5-89b4-55227f9eba0e]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:38:06 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeGVXWCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23563366361663135', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563366361663135', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2130357941',display_name='tempest-TestVolumeBootPattern-server-2130357941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2130357941',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg7lN4gu0O9CJgDpyBhy0RX3jSYGXDmrd1kKjcONe+vy3hXe0gfOqavEjgU06+fs+8PvDAL8t8WC3udIvRk5S68ldJhrYI9gy8tZpcPsibRZmE5rDqMVaBs/gzMf1AsPA==',key_name='tempest-TestVolumeBootPattern-1852675789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-5kvhs5h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:37:57Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=cc5b695c-5e83-4476-b37a-93e7d59a73ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:d0,bridge_name='br-int',has_traffic_filtering=True,id=e7787e55-f462-4181-8fde-df929ec64ae6,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7787e55-f4') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.objects.instance [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'pci_devices' on Instance uuid cc5b695c-5e83-4476-b37a-93e7d59a73ff {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:38:07 user nova-compute[73012]:   <uuid>cc5b695c-5e83-4476-b37a-93e7d59a73ff</uuid>
Aug 14 12:38:07 user nova-compute[73012]:   <name>instance-0000002e</name>
Aug 14 12:38:07 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:38:07 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:38:07 user nova-compute[73012]:   <metadata>
Aug 14 12:38:07 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:38:07 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:38:07 user nova-compute[73012]:       <nova:name>tempest-TestVolumeBootPattern-server-2130357941</nova:name>
Aug 14 12:38:07 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:38:06</nova:creationTime>
Aug 14 12:38:07 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:38:07 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:38:07 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:38:07 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:38:07 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:38:07 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:38:07 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:38:07 user nova-compute[73012]:       <nova:owner>
Aug 14 12:38:07 user nova-compute[73012]:         <nova:user uuid="0311f0fd37f143739604c409233537fa">tempest-TestVolumeBootPattern-1572075418-project-member</nova:user>
Aug 14 12:38:07 user nova-compute[73012]:         <nova:project uuid="7699b5c3fcc34a619e5d0d066e8ff642">tempest-TestVolumeBootPattern-1572075418</nova:project>
Aug 14 12:38:07 user nova-compute[73012]:       </nova:owner>
Aug 14 12:38:07 user nova-compute[73012]:       <nova:ports>
Aug 14 12:38:07 user nova-compute[73012]:         <nova:port uuid="e7787e55-f462-4181-8fde-df929ec64ae6">
Aug 14 12:38:07 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 12:38:07 user nova-compute[73012]:         </nova:port>
Aug 14 12:38:07 user nova-compute[73012]:       </nova:ports>
Aug 14 12:38:07 user nova-compute[73012]:     </nova:instance>
Aug 14 12:38:07 user nova-compute[73012]:   </metadata>
Aug 14 12:38:07 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:38:07 user nova-compute[73012]:     <system>
Aug 14 12:38:07 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:38:07 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:38:07 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:38:07 user nova-compute[73012]:       <entry name="serial">cc5b695c-5e83-4476-b37a-93e7d59a73ff</entry>
Aug 14 12:38:07 user nova-compute[73012]:       <entry name="uuid">cc5b695c-5e83-4476-b37a-93e7d59a73ff</entry>
Aug 14 12:38:07 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:38:07 user nova-compute[73012]:     </system>
Aug 14 12:38:07 user nova-compute[73012]:   </sysinfo>
Aug 14 12:38:07 user nova-compute[73012]:   <os>
Aug 14 12:38:07 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:38:07 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:38:07 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:38:07 user nova-compute[73012]:   </os>
Aug 14 12:38:07 user nova-compute[73012]:   <features>
Aug 14 12:38:07 user nova-compute[73012]:     <acpi/>
Aug 14 12:38:07 user nova-compute[73012]:     <apic/>
Aug 14 12:38:07 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:38:07 user nova-compute[73012]:   </features>
Aug 14 12:38:07 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:38:07 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:38:07 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:38:07 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:38:07 user nova-compute[73012]:   </clock>
Aug 14 12:38:07 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:38:07 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:38:07 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:38:07 user nova-compute[73012]:   </cpu>
Aug 14 12:38:07 user nova-compute[73012]:   <devices>
Aug 14 12:38:07 user nova-compute[73012]:     <disk type="block" device="disk">
Aug 14 12:38:07 user nova-compute[73012]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:38:07 user nova-compute[73012]:       <source dev="/dev/sdc"/>
Aug 14 12:38:07 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:38:07 user nova-compute[73012]:       <serial>809d17d5-713b-4803-a08b-897b4f209142</serial>
Aug 14 12:38:07 user nova-compute[73012]:     </disk>
Aug 14 12:38:07 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:38:07 user nova-compute[73012]:       <mac address="fa:16:3e:37:37:d0"/>
Aug 14 12:38:07 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:38:07 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:38:07 user nova-compute[73012]:       <target dev="tape7787e55-f4"/>
Aug 14 12:38:07 user nova-compute[73012]:     </interface>
Aug 14 12:38:07 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:38:07 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/cc5b695c-5e83-4476-b37a-93e7d59a73ff/console.log" append="off"/>
Aug 14 12:38:07 user nova-compute[73012]:     </serial>
Aug 14 12:38:07 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:38:07 user nova-compute[73012]:     <video>
Aug 14 12:38:07 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:38:07 user nova-compute[73012]:     </video>
Aug 14 12:38:07 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:38:07 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:38:07 user nova-compute[73012]:     </rng>
Aug 14 12:38:07 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:38:07 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:38:07 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:38:07 user nova-compute[73012]:     </memballoon>
Aug 14 12:38:07 user nova-compute[73012]:   </devices>
Aug 14 12:38:07 user nova-compute[73012]: </domain>
Aug 14 12:38:07 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2130357941',display_name='tempest-TestVolumeBootPattern-server-2130357941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2130357941',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg7lN4gu0O9CJgDpyBhy0RX3jSYGXDmrd1kKjcONe+vy3hXe0gfOqavEjgU06+fs+8PvDAL8t8WC3udIvRk5S68ldJhrYI9gy8tZpcPsibRZmE5rDqMVaBs/gzMf1AsPA==',key_name='tempest-TestVolumeBootPattern-1852675789',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-5kvhs5h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:37:57Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=cc5b695c-5e83-4476-b37a-93e7d59a73ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:d0,bridge_name='br-int',has_traffic_filtering=True,id=e7787e55-f462-4181-8fde-df929ec64ae6,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7787e55-f4') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG os_vif [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:d0,bridge_name='br-int',has_traffic_filtering=True,id=e7787e55-f462-4181-8fde-df929ec64ae6,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7787e55-f4') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7787e55-f4, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7787e55-f4, col_values=(('external_ids', {'iface-id': 'e7787e55-f462-4181-8fde-df929ec64ae6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:37:d0', 'vm-uuid': 'cc5b695c-5e83-4476-b37a-93e7d59a73ff'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:07 user nova-compute[73012]: INFO os_vif [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:d0,bridge_name='br-int',has_traffic_filtering=True,id=e7787e55-f462-4181-8fde-df929ec64ae6,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7787e55-f4')
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:38:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] No VIF found with MAC fa:16:3e:37:37:d0, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:38:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-c732d6c2-eb53-4217-8052-190f7f4a60ee req-135f1f09-b3ff-4861-a5c0-2b35ac840b83 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received event network-vif-plugged-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:38:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c732d6c2-eb53-4217-8052-190f7f4a60ee req-135f1f09-b3ff-4861-a5c0-2b35ac840b83 service nova] Acquiring lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c732d6c2-eb53-4217-8052-190f7f4a60ee req-135f1f09-b3ff-4861-a5c0-2b35ac840b83 service nova] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c732d6c2-eb53-4217-8052-190f7f4a60ee req-135f1f09-b3ff-4861-a5c0-2b35ac840b83 service nova] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:09 user nova-compute[73012]: DEBUG nova.compute.manager [req-c732d6c2-eb53-4217-8052-190f7f4a60ee req-135f1f09-b3ff-4861-a5c0-2b35ac840b83 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] No waiting events found dispatching network-vif-plugged-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:38:09 user nova-compute[73012]: WARNING nova.compute.manager [req-c732d6c2-eb53-4217-8052-190f7f4a60ee req-135f1f09-b3ff-4861-a5c0-2b35ac840b83 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received unexpected event network-vif-plugged-e7787e55-f462-4181-8fde-df929ec64ae6 for instance with vm_state building and task_state spawning.
Aug 14 12:38:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016691.2770526, cc5b695c-5e83-4476-b37a-93e7d59a73ff => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:38:11 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] VM Resumed (Lifecycle Event)
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:38:11 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Instance spawned successfully.
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:11 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016691.2788124, cc5b695c-5e83-4476-b37a-93e7d59a73ff => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:38:11 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] VM Started (Lifecycle Event)
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:38:11 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:38:11 user nova-compute[73012]: INFO nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:38:11 user nova-compute[73012]: INFO nova.compute.manager [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Took 14.78 seconds to build instance.
Aug 14 12:38:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-94221711-aada-45b5-94f8-1fef0f325f46 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.872s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-d5e88b02-cf0b-4292-a07c-62e184ed6d6f req-ec2d8e4a-d508-45f7-8e38-f2186437f478 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received event network-vif-plugged-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d5e88b02-cf0b-4292-a07c-62e184ed6d6f req-ec2d8e4a-d508-45f7-8e38-f2186437f478 service nova] Acquiring lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d5e88b02-cf0b-4292-a07c-62e184ed6d6f req-ec2d8e4a-d508-45f7-8e38-f2186437f478 service nova] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d5e88b02-cf0b-4292-a07c-62e184ed6d6f req-ec2d8e4a-d508-45f7-8e38-f2186437f478 service nova] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-d5e88b02-cf0b-4292-a07c-62e184ed6d6f req-ec2d8e4a-d508-45f7-8e38-f2186437f478 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] No waiting events found dispatching network-vif-plugged-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:38:11 user nova-compute[73012]: WARNING nova.compute.manager [req-d5e88b02-cf0b-4292-a07c-62e184ed6d6f req-ec2d8e4a-d508-45f7-8e38-f2186437f478 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received unexpected event network-vif-plugged-e7787e55-f462-4181-8fde-df929ec64ae6 for instance with vm_state active and task_state None.
Aug 14 12:38:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:38:13 user nova-compute[73012]: INFO nova.compute.claims [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Claim successful on node user
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:38:13 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.policy [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbc96fd6e33b4e4aae1de009a457c08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef9274d18f04a30bb977bb9ef163bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:38:13 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Creating image(s)
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "/opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "/opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.202s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk 1073741824" returned: 0 in 0.068s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Cannot resize image /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'migration_context' on Instance uuid b8496a99-5a43-4042-9a89-2b17071d68ff {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Ensure instance console log exists: /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:14 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Successfully created port: b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:38:15 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Successfully updated port: b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:38:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:38:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquired lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:38:15 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:38:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-fc9ff732-c6a4-4d49-8aa2-5bddea818a49 req-c8372469-5abb-46ce-9117-c35b91fcc6ac service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-changed-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:38:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-fc9ff732-c6a4-4d49-8aa2-5bddea818a49 req-c8372469-5abb-46ce-9117-c35b91fcc6ac service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Refreshing instance network info cache due to event network-changed-b60283be-1efe-48ab-b0fd-219cca611193. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:38:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fc9ff732-c6a4-4d49-8aa2-5bddea818a49 req-c8372469-5abb-46ce-9117-c35b91fcc6ac service nova] Acquiring lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:38:15 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updating instance_info_cache with network_info: [{"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Releasing lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Instance network_info: |[{"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fc9ff732-c6a4-4d49-8aa2-5bddea818a49 req-c8372469-5abb-46ce-9117-c35b91fcc6ac service nova] Acquired lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.network.neutron [req-fc9ff732-c6a4-4d49-8aa2-5bddea818a49 req-c8372469-5abb-46ce-9117-c35b91fcc6ac service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Refreshing network info cache for port b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Start _get_guest_xml network_info=[{"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:38:16 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:38:16 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-903267946',display_name='tempest-AttachVolumeNegativeTest-server-903267946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-903267946',id=47,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD59CJgosnYdsd1Kev/Fil/p9WwvCGySwm7nji60N8Ub2ymjIyZAIW808AF94s7Kaw9qFTmXuddOjeMCG5ZJBDixCnIWFf4q5xXpM/jhiDHQsapC/ZI+1cUTlClIGWem+w==',key_name='tempest-keypair-808117168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-v5vw0m09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:38:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=b8496a99-5a43-4042-9a89-2b17071d68ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b60283be-1efe-48ab-b0fd-219cca611193,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60283be-1e') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'pci_devices' on Instance uuid b8496a99-5a43-4042-9a89-2b17071d68ff {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:38:16 user nova-compute[73012]:   <uuid>b8496a99-5a43-4042-9a89-2b17071d68ff</uuid>
Aug 14 12:38:16 user nova-compute[73012]:   <name>instance-0000002f</name>
Aug 14 12:38:16 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:38:16 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:38:16 user nova-compute[73012]:   <metadata>
Aug 14 12:38:16 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:38:16 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:38:16 user nova-compute[73012]:       <nova:name>tempest-AttachVolumeNegativeTest-server-903267946</nova:name>
Aug 14 12:38:16 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:38:16</nova:creationTime>
Aug 14 12:38:16 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:38:16 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:38:16 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:38:16 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:38:16 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:38:16 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:38:16 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:38:16 user nova-compute[73012]:       <nova:owner>
Aug 14 12:38:16 user nova-compute[73012]:         <nova:user uuid="cbc96fd6e33b4e4aae1de009a457c08a">tempest-AttachVolumeNegativeTest-1684368273-project-member</nova:user>
Aug 14 12:38:16 user nova-compute[73012]:         <nova:project uuid="bef9274d18f04a30bb977bb9ef163bc5">tempest-AttachVolumeNegativeTest-1684368273</nova:project>
Aug 14 12:38:16 user nova-compute[73012]:       </nova:owner>
Aug 14 12:38:16 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:38:16 user nova-compute[73012]:       <nova:ports>
Aug 14 12:38:16 user nova-compute[73012]:         <nova:port uuid="b60283be-1efe-48ab-b0fd-219cca611193">
Aug 14 12:38:16 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 12:38:16 user nova-compute[73012]:         </nova:port>
Aug 14 12:38:16 user nova-compute[73012]:       </nova:ports>
Aug 14 12:38:16 user nova-compute[73012]:     </nova:instance>
Aug 14 12:38:16 user nova-compute[73012]:   </metadata>
Aug 14 12:38:16 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:38:16 user nova-compute[73012]:     <system>
Aug 14 12:38:16 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:38:16 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:38:16 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:38:16 user nova-compute[73012]:       <entry name="serial">b8496a99-5a43-4042-9a89-2b17071d68ff</entry>
Aug 14 12:38:16 user nova-compute[73012]:       <entry name="uuid">b8496a99-5a43-4042-9a89-2b17071d68ff</entry>
Aug 14 12:38:16 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:38:16 user nova-compute[73012]:     </system>
Aug 14 12:38:16 user nova-compute[73012]:   </sysinfo>
Aug 14 12:38:16 user nova-compute[73012]:   <os>
Aug 14 12:38:16 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:38:16 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:38:16 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:38:16 user nova-compute[73012]:   </os>
Aug 14 12:38:16 user nova-compute[73012]:   <features>
Aug 14 12:38:16 user nova-compute[73012]:     <acpi/>
Aug 14 12:38:16 user nova-compute[73012]:     <apic/>
Aug 14 12:38:16 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:38:16 user nova-compute[73012]:   </features>
Aug 14 12:38:16 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:38:16 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:38:16 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:38:16 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:38:16 user nova-compute[73012]:   </clock>
Aug 14 12:38:16 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:38:16 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:38:16 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:38:16 user nova-compute[73012]:   </cpu>
Aug 14 12:38:16 user nova-compute[73012]:   <devices>
Aug 14 12:38:16 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:38:16 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:38:16 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk"/>
Aug 14 12:38:16 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:38:16 user nova-compute[73012]:     </disk>
Aug 14 12:38:16 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:38:16 user nova-compute[73012]:       <mac address="fa:16:3e:7a:3c:ff"/>
Aug 14 12:38:16 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:38:16 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:38:16 user nova-compute[73012]:       <target dev="tapb60283be-1e"/>
Aug 14 12:38:16 user nova-compute[73012]:     </interface>
Aug 14 12:38:16 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:38:16 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/console.log" append="off"/>
Aug 14 12:38:16 user nova-compute[73012]:     </serial>
Aug 14 12:38:16 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:38:16 user nova-compute[73012]:     <video>
Aug 14 12:38:16 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:38:16 user nova-compute[73012]:     </video>
Aug 14 12:38:16 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:38:16 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:38:16 user nova-compute[73012]:     </rng>
Aug 14 12:38:16 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:38:16 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:38:16 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:38:16 user nova-compute[73012]:     </memballoon>
Aug 14 12:38:16 user nova-compute[73012]:   </devices>
Aug 14 12:38:16 user nova-compute[73012]: </domain>
Aug 14 12:38:16 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-903267946',display_name='tempest-AttachVolumeNegativeTest-server-903267946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-903267946',id=47,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD59CJgosnYdsd1Kev/Fil/p9WwvCGySwm7nji60N8Ub2ymjIyZAIW808AF94s7Kaw9qFTmXuddOjeMCG5ZJBDixCnIWFf4q5xXpM/jhiDHQsapC/ZI+1cUTlClIGWem+w==',key_name='tempest-keypair-808117168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-v5vw0m09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:38:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=b8496a99-5a43-4042-9a89-2b17071d68ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b60283be-1efe-48ab-b0fd-219cca611193,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60283be-1e') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG os_vif [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b60283be-1efe-48ab-b0fd-219cca611193,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60283be-1e') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb60283be-1e, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb60283be-1e, col_values=(('external_ids', {'iface-id': 'b60283be-1efe-48ab-b0fd-219cca611193', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:3c:ff', 'vm-uuid': 'b8496a99-5a43-4042-9a89-2b17071d68ff'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:16 user nova-compute[73012]: INFO os_vif [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b60283be-1efe-48ab-b0fd-219cca611193,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60283be-1e')
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No VIF found with MAC fa:16:3e:7a:3c:ff, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.network.neutron [req-fc9ff732-c6a4-4d49-8aa2-5bddea818a49 req-c8372469-5abb-46ce-9117-c35b91fcc6ac service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updated VIF entry in instance network info cache for port b60283be-1efe-48ab-b0fd-219cca611193. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG nova.network.neutron [req-fc9ff732-c6a4-4d49-8aa2-5bddea818a49 req-c8372469-5abb-46ce-9117-c35b91fcc6ac service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updating instance_info_cache with network_info: [{"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:38:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fc9ff732-c6a4-4d49-8aa2-5bddea818a49 req-c8372469-5abb-46ce-9117-c35b91fcc6ac service nova] Releasing lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:38:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-6c3fbc91-caa2-4d1c-87f6-9b778cb113ba req-30597adb-c2d9-4c24-9d7a-13f7edaaa259 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:38:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6c3fbc91-caa2-4d1c-87f6-9b778cb113ba req-30597adb-c2d9-4c24-9d7a-13f7edaaa259 service nova] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6c3fbc91-caa2-4d1c-87f6-9b778cb113ba req-30597adb-c2d9-4c24-9d7a-13f7edaaa259 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6c3fbc91-caa2-4d1c-87f6-9b778cb113ba req-30597adb-c2d9-4c24-9d7a-13f7edaaa259 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:18 user nova-compute[73012]: DEBUG nova.compute.manager [req-6c3fbc91-caa2-4d1c-87f6-9b778cb113ba req-30597adb-c2d9-4c24-9d7a-13f7edaaa259 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] No waiting events found dispatching network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:38:18 user nova-compute[73012]: WARNING nova.compute.manager [req-6c3fbc91-caa2-4d1c-87f6-9b778cb113ba req-30597adb-c2d9-4c24-9d7a-13f7edaaa259 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received unexpected event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 for instance with vm_state building and task_state spawning.
Aug 14 12:38:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:18 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016700.1717443, b8496a99-5a43-4042-9a89-2b17071d68ff => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:38:20 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] VM Resumed (Lifecycle Event)
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:38:20 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Instance spawned successfully.
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:38:20 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016700.1719832, b8496a99-5a43-4042-9a89-2b17071d68ff => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:38:20 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] VM Started (Lifecycle Event)
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:38:20 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:38:20 user nova-compute[73012]: INFO nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-0eb1d2e0-6f8a-4805-8867-02d32ba1bf34 req-ecedcb69-b944-4990-b603-9c7730e9fb34 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0eb1d2e0-6f8a-4805-8867-02d32ba1bf34 req-ecedcb69-b944-4990-b603-9c7730e9fb34 service nova] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0eb1d2e0-6f8a-4805-8867-02d32ba1bf34 req-ecedcb69-b944-4990-b603-9c7730e9fb34 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0eb1d2e0-6f8a-4805-8867-02d32ba1bf34 req-ecedcb69-b944-4990-b603-9c7730e9fb34 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:20 user nova-compute[73012]: DEBUG nova.compute.manager [req-0eb1d2e0-6f8a-4805-8867-02d32ba1bf34 req-ecedcb69-b944-4990-b603-9c7730e9fb34 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] No waiting events found dispatching network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:38:20 user nova-compute[73012]: WARNING nova.compute.manager [req-0eb1d2e0-6f8a-4805-8867-02d32ba1bf34 req-ecedcb69-b944-4990-b603-9c7730e9fb34 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received unexpected event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 for instance with vm_state building and task_state spawning.
Aug 14 12:38:20 user nova-compute[73012]: INFO nova.compute.manager [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Took 7.33 seconds to build instance.
Aug 14 12:38:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9776f3d1-0c78-41a4-9b50-fba4f933ca6f tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.458s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquiring lock "74e0cd5d-680e-4139-9f52-b6cb392160fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:38:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:39 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:38:39 user nova-compute[73012]: INFO nova.compute.claims [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Claim successful on node user
Aug 14 12:38:40 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:38:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:38:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG nova.policy [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f4144ed51954006a6d7c893be2d6e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0219e3b5ebdd47939139a6b797184ea7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:38:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Creating image(s)
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquiring lock "/opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "/opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "/opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk 1073741824" returned: 0 in 0.052s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:40 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Successfully created port: d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Cannot resize image /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.objects.instance [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lazy-loading 'migration_context' on Instance uuid 74e0cd5d-680e-4139-9f52-b6cb392160fc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Ensure instance console log exists: /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Successfully updated port: d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquiring lock "refresh_cache-74e0cd5d-680e-4139-9f52-b6cb392160fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquired lock "refresh_cache-74e0cd5d-680e-4139-9f52-b6cb392160fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-3d15116e-db0a-4dd4-87d5-af0f0d74c866 req-139bff5b-f12d-40bc-b657-62e927b20218 service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received event network-changed-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.compute.manager [req-3d15116e-db0a-4dd4-87d5-af0f0d74c866 req-139bff5b-f12d-40bc-b657-62e927b20218 service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Refreshing instance network info cache due to event network-changed-d72ed4f0-1149-4d0a-bf1d-5325d7983152. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3d15116e-db0a-4dd4-87d5-af0f0d74c866 req-139bff5b-f12d-40bc-b657-62e927b20218 service nova] Acquiring lock "refresh_cache-74e0cd5d-680e-4139-9f52-b6cb392160fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:38:41 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.network.neutron [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Updating instance_info_cache with network_info: [{"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Releasing lock "refresh_cache-74e0cd5d-680e-4139-9f52-b6cb392160fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Instance network_info: |[{"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3d15116e-db0a-4dd4-87d5-af0f0d74c866 req-139bff5b-f12d-40bc-b657-62e927b20218 service nova] Acquired lock "refresh_cache-74e0cd5d-680e-4139-9f52-b6cb392160fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-3d15116e-db0a-4dd4-87d5-af0f0d74c866 req-139bff5b-f12d-40bc-b657-62e927b20218 service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Refreshing network info cache for port d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Start _get_guest_xml network_info=[{"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:38:42 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:38:42 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1047377860',display_name='tempest-VolumesActionsTest-instance-1047377860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1047377860',id=48,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0219e3b5ebdd47939139a6b797184ea7',ramdisk_id='',reservation_id='r-5wadlw1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1733823408',owner_user_name='tempest-VolumesActionsTest-1733823408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:38:40Z,user_data=None,user_id='0f4144ed51954006a6d7c893be2d6e33',uuid=74e0cd5d-680e-4139-9f52-b6cb392160fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Converting VIF {"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=d72ed4f0-1149-4d0a-bf1d-5325d7983152,network=Network(2cc3b568-36b5-43a9-b26d-64090a639722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72ed4f0-11') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.objects.instance [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lazy-loading 'pci_devices' on Instance uuid 74e0cd5d-680e-4139-9f52-b6cb392160fc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:38:42 user nova-compute[73012]:   <uuid>74e0cd5d-680e-4139-9f52-b6cb392160fc</uuid>
Aug 14 12:38:42 user nova-compute[73012]:   <name>instance-00000030</name>
Aug 14 12:38:42 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:38:42 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:38:42 user nova-compute[73012]:   <metadata>
Aug 14 12:38:42 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:38:42 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:38:42 user nova-compute[73012]:       <nova:name>tempest-VolumesActionsTest-instance-1047377860</nova:name>
Aug 14 12:38:42 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:38:42</nova:creationTime>
Aug 14 12:38:42 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:38:42 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:38:42 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:38:42 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:38:42 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:38:42 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:38:42 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:38:42 user nova-compute[73012]:       <nova:owner>
Aug 14 12:38:42 user nova-compute[73012]:         <nova:user uuid="0f4144ed51954006a6d7c893be2d6e33">tempest-VolumesActionsTest-1733823408-project-member</nova:user>
Aug 14 12:38:42 user nova-compute[73012]:         <nova:project uuid="0219e3b5ebdd47939139a6b797184ea7">tempest-VolumesActionsTest-1733823408</nova:project>
Aug 14 12:38:42 user nova-compute[73012]:       </nova:owner>
Aug 14 12:38:42 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:38:42 user nova-compute[73012]:       <nova:ports>
Aug 14 12:38:42 user nova-compute[73012]:         <nova:port uuid="d72ed4f0-1149-4d0a-bf1d-5325d7983152">
Aug 14 12:38:42 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 12:38:42 user nova-compute[73012]:         </nova:port>
Aug 14 12:38:42 user nova-compute[73012]:       </nova:ports>
Aug 14 12:38:42 user nova-compute[73012]:     </nova:instance>
Aug 14 12:38:42 user nova-compute[73012]:   </metadata>
Aug 14 12:38:42 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:38:42 user nova-compute[73012]:     <system>
Aug 14 12:38:42 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:38:42 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:38:42 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:38:42 user nova-compute[73012]:       <entry name="serial">74e0cd5d-680e-4139-9f52-b6cb392160fc</entry>
Aug 14 12:38:42 user nova-compute[73012]:       <entry name="uuid">74e0cd5d-680e-4139-9f52-b6cb392160fc</entry>
Aug 14 12:38:42 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:38:42 user nova-compute[73012]:     </system>
Aug 14 12:38:42 user nova-compute[73012]:   </sysinfo>
Aug 14 12:38:42 user nova-compute[73012]:   <os>
Aug 14 12:38:42 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:38:42 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:38:42 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:38:42 user nova-compute[73012]:   </os>
Aug 14 12:38:42 user nova-compute[73012]:   <features>
Aug 14 12:38:42 user nova-compute[73012]:     <acpi/>
Aug 14 12:38:42 user nova-compute[73012]:     <apic/>
Aug 14 12:38:42 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:38:42 user nova-compute[73012]:   </features>
Aug 14 12:38:42 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:38:42 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:38:42 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:38:42 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:38:42 user nova-compute[73012]:   </clock>
Aug 14 12:38:42 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:38:42 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:38:42 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:38:42 user nova-compute[73012]:   </cpu>
Aug 14 12:38:42 user nova-compute[73012]:   <devices>
Aug 14 12:38:42 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:38:42 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:38:42 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk"/>
Aug 14 12:38:42 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:38:42 user nova-compute[73012]:     </disk>
Aug 14 12:38:42 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:38:42 user nova-compute[73012]:       <mac address="fa:16:3e:39:a9:5a"/>
Aug 14 12:38:42 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:38:42 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:38:42 user nova-compute[73012]:       <target dev="tapd72ed4f0-11"/>
Aug 14 12:38:42 user nova-compute[73012]:     </interface>
Aug 14 12:38:42 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:38:42 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/console.log" append="off"/>
Aug 14 12:38:42 user nova-compute[73012]:     </serial>
Aug 14 12:38:42 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:38:42 user nova-compute[73012]:     <video>
Aug 14 12:38:42 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:38:42 user nova-compute[73012]:     </video>
Aug 14 12:38:42 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:38:42 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:38:42 user nova-compute[73012]:     </rng>
Aug 14 12:38:42 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:38:42 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:38:42 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:38:42 user nova-compute[73012]:     </memballoon>
Aug 14 12:38:42 user nova-compute[73012]:   </devices>
Aug 14 12:38:42 user nova-compute[73012]: </domain>
Aug 14 12:38:42 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1047377860',display_name='tempest-VolumesActionsTest-instance-1047377860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1047377860',id=48,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0219e3b5ebdd47939139a6b797184ea7',ramdisk_id='',reservation_id='r-5wadlw1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1733823408',owner_user_name='tempest-VolumesActionsTest-1733823408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:38:40Z,user_data=None,user_id='0f4144ed51954006a6d7c893be2d6e33',uuid=74e0cd5d-680e-4139-9f52-b6cb392160fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Converting VIF {"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=d72ed4f0-1149-4d0a-bf1d-5325d7983152,network=Network(2cc3b568-36b5-43a9-b26d-64090a639722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72ed4f0-11') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG os_vif [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=d72ed4f0-1149-4d0a-bf1d-5325d7983152,network=Network(2cc3b568-36b5-43a9-b26d-64090a639722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72ed4f0-11') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd72ed4f0-11, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd72ed4f0-11, col_values=(('external_ids', {'iface-id': 'd72ed4f0-1149-4d0a-bf1d-5325d7983152', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:a9:5a', 'vm-uuid': '74e0cd5d-680e-4139-9f52-b6cb392160fc'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:42 user nova-compute[73012]: INFO os_vif [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=d72ed4f0-1149-4d0a-bf1d-5325d7983152,network=Network(2cc3b568-36b5-43a9-b26d-64090a639722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72ed4f0-11')
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] No VIF found with MAC fa:16:3e:39:a9:5a, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-3d15116e-db0a-4dd4-87d5-af0f0d74c866 req-139bff5b-f12d-40bc-b657-62e927b20218 service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Updated VIF entry in instance network info cache for port d72ed4f0-1149-4d0a-bf1d-5325d7983152. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG nova.network.neutron [req-3d15116e-db0a-4dd4-87d5-af0f0d74c866 req-139bff5b-f12d-40bc-b657-62e927b20218 service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Updating instance_info_cache with network_info: [{"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:38:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3d15116e-db0a-4dd4-87d5-af0f0d74c866 req-139bff5b-f12d-40bc-b657-62e927b20218 service nova] Releasing lock "refresh_cache-74e0cd5d-680e-4139-9f52-b6cb392160fc" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:38:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-9416da53-1ba8-49fc-8475-1559111e0361 req-8e0c3b33-9018-418a-bd8d-21e1c248900e service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received event network-vif-plugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:38:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9416da53-1ba8-49fc-8475-1559111e0361 req-8e0c3b33-9018-418a-bd8d-21e1c248900e service nova] Acquiring lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9416da53-1ba8-49fc-8475-1559111e0361 req-8e0c3b33-9018-418a-bd8d-21e1c248900e service nova] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-9416da53-1ba8-49fc-8475-1559111e0361 req-8e0c3b33-9018-418a-bd8d-21e1c248900e service nova] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:43 user nova-compute[73012]: DEBUG nova.compute.manager [req-9416da53-1ba8-49fc-8475-1559111e0361 req-8e0c3b33-9018-418a-bd8d-21e1c248900e service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] No waiting events found dispatching network-vif-plugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:38:43 user nova-compute[73012]: WARNING nova.compute.manager [req-9416da53-1ba8-49fc-8475-1559111e0361 req-8e0c3b33-9018-418a-bd8d-21e1c248900e service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received unexpected event network-vif-plugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 for instance with vm_state building and task_state spawning.
Aug 14 12:38:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016725.745774, 74e0cd5d-680e-4139-9f52-b6cb392160fc => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:38:45 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] VM Resumed (Lifecycle Event)
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:38:45 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Instance spawned successfully.
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:38:45 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016725.7470222, 74e0cd5d-680e-4139-9f52-b6cb392160fc => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:38:45 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] VM Started (Lifecycle Event)
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:38:45 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:38:45 user nova-compute[73012]: INFO nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Took 5.41 seconds to spawn the instance on the hypervisor.
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:38:45 user nova-compute[73012]: INFO nova.compute.manager [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Took 6.01 seconds to build instance.
Aug 14 12:38:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-84adca1e-ee57-437b-a98f-78a3a29af24c tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.106s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-26bca32d-480d-494d-b5d6-ecc928b9cf15 req-a9f1053e-bdde-4bc4-8e37-21657c87e59f service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received event network-vif-plugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-26bca32d-480d-494d-b5d6-ecc928b9cf15 req-a9f1053e-bdde-4bc4-8e37-21657c87e59f service nova] Acquiring lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-26bca32d-480d-494d-b5d6-ecc928b9cf15 req-a9f1053e-bdde-4bc4-8e37-21657c87e59f service nova] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-26bca32d-480d-494d-b5d6-ecc928b9cf15 req-a9f1053e-bdde-4bc4-8e37-21657c87e59f service nova] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:45 user nova-compute[73012]: DEBUG nova.compute.manager [req-26bca32d-480d-494d-b5d6-ecc928b9cf15 req-a9f1053e-bdde-4bc4-8e37-21657c87e59f service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] No waiting events found dispatching network-vif-plugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:38:45 user nova-compute[73012]: WARNING nova.compute.manager [req-26bca32d-480d-494d-b5d6-ecc928b9cf15 req-a9f1053e-bdde-4bc4-8e37-21657c87e59f service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received unexpected event network-vif-plugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 for instance with vm_state active and task_state None.
Aug 14 12:38:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:38:52 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:38:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:52 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:38:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:38:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:38:54 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:38:54 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8087MB free_disk=25.367385864257812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4cfcbac9-7014-48b4-a131-2c1b83838a4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0748d973-3d1f-4197-b850-4cf6b5ab23b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance cc5b695c-5e83-4476-b37a-93e7d59a73ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance b8496a99-5a43-4042-9a89-2b17071d68ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 74e0cd5d-680e-4139-9f52-b6cb392160fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:38:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:38:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:38:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:38:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:38:56 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:38:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:38:56 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:38:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:38:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:38:56 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:38:56 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 4cfcbac9-7014-48b4-a131-2c1b83838a4b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:38:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updating instance_info_cache with network_info: [{"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:38:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:38:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:38:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:38:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:38:59 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:39:00 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:39:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:39:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:39:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:39:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:39:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:39:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:39:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:39:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:39:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:39:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:39:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-548f9d97-eba7-4e62-a4bd-c9dc4bf79bec req-818327dc-f6d5-4fbd-b20a-ccf0d2b5e599 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received event network-changed-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG nova.compute.manager [req-548f9d97-eba7-4e62-a4bd-c9dc4bf79bec req-818327dc-f6d5-4fbd-b20a-ccf0d2b5e599 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Refreshing instance network info cache due to event network-changed-fd3ce9bb-890e-49d5-86d2-63a74da9b54d. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-548f9d97-eba7-4e62-a4bd-c9dc4bf79bec req-818327dc-f6d5-4fbd-b20a-ccf0d2b5e599 service nova] Acquiring lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-548f9d97-eba7-4e62-a4bd-c9dc4bf79bec req-818327dc-f6d5-4fbd-b20a-ccf0d2b5e599 service nova] Acquired lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG nova.network.neutron [req-548f9d97-eba7-4e62-a4bd-c9dc4bf79bec req-818327dc-f6d5-4fbd-b20a-ccf0d2b5e599 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Refreshing network info cache for port fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'flavor' on Instance uuid 0748d973-3d1f-4197-b850-4cf6b5ab23b4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:39:35 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Ignoring supplied device name: /dev/vdb
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:39:35 user nova-compute[73012]: INFO nova.compute.manager [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Attaching volume 629e79e2-60ab-4de5-add8-a7a637f8a13c to /dev/vdb
Aug 14 12:39:35 user nova-compute[73012]: DEBUG os_brick.utils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[58826011-5e78-455f-b221-4d865b9ac17a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d1faf1-0d40-472c-886b-ea73e6654869]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG nova.network.neutron [req-548f9d97-eba7-4e62-a4bd-c9dc4bf79bec req-818327dc-f6d5-4fbd-b20a-ccf0d2b5e599 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Updated VIF entry in instance network info cache for port fd3ce9bb-890e-49d5-86d2-63a74da9b54d. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG nova.network.neutron [req-548f9d97-eba7-4e62-a4bd-c9dc4bf79bec req-818327dc-f6d5-4fbd-b20a-ccf0d2b5e599 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Updating instance_info_cache with network_info: [{"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b91923-9fdf-454a-88c1-ab33f0c4a76f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe2ba68-da93-4f20-bd39-9244e43bd51e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-548f9d97-eba7-4e62-a4bd-c9dc4bf79bec req-818327dc-f6d5-4fbd-b20a-ccf0d2b5e599 service nova] Releasing lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:39:35 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:39:35 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d5c023-ce37-4cd6-b773-5af3c9e6621d]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG os_brick.utils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:39:35 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Updating existing volume attachment record: 697ab820-4d00-4313-a01e-c939d8b3625f {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:39:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWaMXUkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:39:44 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:39:44 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:39:44 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[34adaa34-f8ae-44ca-b5b3-7e9516afca6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:39:44 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e722c7-330a-4d49-8ccb-01dffd80fec1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c] added
Aug 14 12:39:44 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.112s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[865a6455-ef1c-4fd6-a1f5-9a59939b4909]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba516ee-1df6-419e-8a3b-ba475da7f58c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWaMXUkZ {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWaMXUkZ" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c432101-78d6-4566-9d82-24bb9f633d4d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RWaMXUkZ'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fafe2b5-8c23-4f73-9a04-bc253fb23762]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[396a23dd-24a9-47dd-b7e4-9655aa4271c9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:39:44 user nova-compute[73012]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)
Aug 14 12:39:44 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:39:44 user nova-compute[73012]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)
Aug 14 12:39:44 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e260b67-f5a6-4a27-a0cd-00f066053250]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c, portal: 172.16.0.220,3260]
Aug 14 12:39:44 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c, portal: 172.16.0.220,3260] successful.
Aug 14 12:39:44 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a49a05-57e8-418c-b8df-a43b2e3daa82]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8b956-70c6-4ced-8718-ca618410de6f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:39:45 user nova-compute[73012]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)
Aug 14 12:39:45 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:39:45 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:39:45 user nova-compute[73012]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)
Aug 14 12:39:45 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:39:45 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[51893e35-b9d5-45f9-affb-8d2660336392]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:45 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWaMXUkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23761306363303563', 'path': '/dev/sdd'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761306363303563', 'path': '/dev/sdd'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'flavor' on Instance uuid 0748d973-3d1f-4197-b850-4cf6b5ab23b4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:39:46 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:39:46 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:39:46 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:39:46 user nova-compute[73012]:   <serial>629e79e2-60ab-4de5-add8-a7a637f8a13c</serial>
Aug 14 12:39:46 user nova-compute[73012]: </disk>
Aug 14 12:39:46 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No VIF found with MAC fa:16:3e:33:fb:4b, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:39:46 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a7b7752f-9200-42f4-b1d8-629ec1b9e40e tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.911s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:39:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-01e2f66a-2c11-4609-b840-e794a042ebee req-b8c9a011-03ce-4a6a-bd75-f5224a8754de service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received event network-changed-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:39:48 user nova-compute[73012]: DEBUG nova.compute.manager [req-01e2f66a-2c11-4609-b840-e794a042ebee req-b8c9a011-03ce-4a6a-bd75-f5224a8754de service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Refreshing instance network info cache due to event network-changed-e7787e55-f462-4181-8fde-df929ec64ae6. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:39:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-01e2f66a-2c11-4609-b840-e794a042ebee req-b8c9a011-03ce-4a6a-bd75-f5224a8754de service nova] Acquiring lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:39:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-01e2f66a-2c11-4609-b840-e794a042ebee req-b8c9a011-03ce-4a6a-bd75-f5224a8754de service nova] Acquired lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:39:48 user nova-compute[73012]: DEBUG nova.network.neutron [req-01e2f66a-2c11-4609-b840-e794a042ebee req-b8c9a011-03ce-4a6a-bd75-f5224a8754de service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Refreshing network info cache for port e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG nova.network.neutron [req-01e2f66a-2c11-4609-b840-e794a042ebee req-b8c9a011-03ce-4a6a-bd75-f5224a8754de service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Updated VIF entry in instance network info cache for port e7787e55-f462-4181-8fde-df929ec64ae6. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG nova.network.neutron [req-01e2f66a-2c11-4609-b840-e794a042ebee req-b8c9a011-03ce-4a6a-bd75-f5224a8754de service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Updating instance_info_cache with network_info: [{"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-01e2f66a-2c11-4609-b840-e794a042ebee req-b8c9a011-03ce-4a6a-bd75-f5224a8754de service nova] Releasing lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-4cbe9a7c-89fa-4c4b-9739-f1c1d69ef9f0 req-149c63ed-cdb7-4439-99c3-3df8d2d8e713 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received event network-changed-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-4cbe9a7c-89fa-4c4b-9739-f1c1d69ef9f0 req-149c63ed-cdb7-4439-99c3-3df8d2d8e713 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Refreshing instance network info cache due to event network-changed-e7787e55-f462-4181-8fde-df929ec64ae6. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4cbe9a7c-89fa-4c4b-9739-f1c1d69ef9f0 req-149c63ed-cdb7-4439-99c3-3df8d2d8e713 service nova] Acquiring lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4cbe9a7c-89fa-4c4b-9739-f1c1d69ef9f0 req-149c63ed-cdb7-4439-99c3-3df8d2d8e713 service nova] Acquired lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG nova.network.neutron [req-4cbe9a7c-89fa-4c4b-9739-f1c1d69ef9f0 req-149c63ed-cdb7-4439-99c3-3df8d2d8e713 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Refreshing network info cache for port e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:39:49 user nova-compute[73012]: INFO nova.compute.manager [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Terminating instance
Aug 14 12:39:49 user nova-compute[73012]: DEBUG nova.compute.manager [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-1ec941f7-c772-4d94-a147-200c5d620ab8 req-0bdb9415-b25a-4352-8d9c-f13329b975c4 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received event network-vif-unplugged-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1ec941f7-c772-4d94-a147-200c5d620ab8 req-0bdb9415-b25a-4352-8d9c-f13329b975c4 service nova] Acquiring lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1ec941f7-c772-4d94-a147-200c5d620ab8 req-0bdb9415-b25a-4352-8d9c-f13329b975c4 service nova] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1ec941f7-c772-4d94-a147-200c5d620ab8 req-0bdb9415-b25a-4352-8d9c-f13329b975c4 service nova] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-1ec941f7-c772-4d94-a147-200c5d620ab8 req-0bdb9415-b25a-4352-8d9c-f13329b975c4 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] No waiting events found dispatching network-vif-unplugged-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.compute.manager [req-1ec941f7-c772-4d94-a147-200c5d620ab8 req-0bdb9415-b25a-4352-8d9c-f13329b975c4 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received event network-vif-unplugged-e7787e55-f462-4181-8fde-df929ec64ae6 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:39:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Instance destroyed successfully.
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.objects.instance [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'resources' on Instance uuid cc5b695c-5e83-4476-b37a-93e7d59a73ff {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2130357941',display_name='tempest-TestVolumeBootPattern-server-2130357941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2130357941',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg7lN4gu0O9CJgDpyBhy0RX3jSYGXDmrd1kKjcONe+vy3hXe0gfOqavEjgU06+fs+8PvDAL8t8WC3udIvRk5S68ldJhrYI9gy8tZpcPsibRZmE5rDqMVaBs/gzMf1AsPA==',key_name='tempest-TestVolumeBootPattern-1852675789',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:38:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-5kvhs5h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:38:11Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=cc5b695c-5e83-4476-b37a-93e7d59a73ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:37:d0,bridge_name='br-int',has_traffic_filtering=True,id=e7787e55-f462-4181-8fde-df929ec64ae6,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7787e55-f4') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_vif [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:37:d0,bridge_name='br-int',has_traffic_filtering=True,id=e7787e55-f462-4181-8fde-df929ec64ae6,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7787e55-f4') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7787e55-f4, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:39:50 user nova-compute[73012]: INFO os_vif [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:37:d0,bridge_name='br-int',has_traffic_filtering=True,id=e7787e55-f462-4181-8fde-df929ec64ae6,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7787e55-f4')
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BeGVXWCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:39:50 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-4cbe9a7c-89fa-4c4b-9739-f1c1d69ef9f0 req-149c63ed-cdb7-4439-99c3-3df8d2d8e713 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Updated VIF entry in instance network info cache for port e7787e55-f462-4181-8fde-df929ec64ae6. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-4cbe9a7c-89fa-4c4b-9739-f1c1d69ef9f0 req-149c63ed-cdb7-4439-99c3-3df8d2d8e713 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Updating instance_info_cache with network_info: [{"id": "e7787e55-f462-4181-8fde-df929ec64ae6", "address": "fa:16:3e:37:37:d0", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7787e55-f4", "ovs_interfaceid": "e7787e55-f462-4181-8fde-df929ec64ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb67f36-513d-4aad-8b2b-8cedb5d7a857]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-4cbe9a7c-89fa-4c4b-9739-f1c1d69ef9f0 req-149c63ed-cdb7-4439-99c3-3df8d2d8e713 service nova] Releasing lock "refresh_cache-cc5b695c-5e83-4476-b37a-93e7d59a73ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f7f2c7-1bea-4580-8530-51e2257f392f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:39:50 user nova-compute[73012]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)
Aug 14 12:39:50 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:39:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:39:50 user nova-compute[73012]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 (non-flash)
Aug 14 12:39:50 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:39:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aacdff2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[afec07fd-a9d2-4efa-a601-7745a34f83e0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec87153-7b5c-42d2-9ee1-b84269301997]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b14372-1c31-4cfc-ac9c-aebeaa7c3f19]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e388f-ca1e-4e9d-86c1-c8a56dd4c53c]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_267f0696', '/dev/disk/by-id/scsi-1SCST_BIO267f0696-5c6caf155baea772', '/dev/disk/by-id/scsi-23563366361663135') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40ff049-5c10-451e-bb97-9fdbc1dc7dd0]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5d06ee-08f8-40a6-b582-ca77831d442a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ed6f9c-ffc1-4d9f-9aaf-60d5700ddb59]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142, portal: 172.16.0.220,3260]
Aug 14 12:39:50 user nova-compute[73012]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142, portal: 172.16.0.220,3260] successful.
Aug 14 12:39:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809d17d5-713b-4803-a08b-897b4f209142 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c53b9e-78cc-46cf-9287-6390698be916]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== disconnect_volume: return (291ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:39:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:39:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Deleting instance files /opt/stack/data/nova/instances/cc5b695c-5e83-4476-b37a-93e7d59a73ff_del
Aug 14 12:39:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Deletion of /opt/stack/data/nova/instances/cc5b695c-5e83-4476-b37a-93e7d59a73ff_del complete
Aug 14 12:39:51 user nova-compute[73012]: INFO nova.compute.manager [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 12:39:51 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:39:51 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:39:51 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:39:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:51 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:39:51 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Took 0.53 seconds to deallocate network for instance.
Aug 14 12:39:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-761cda04-1664-414a-9f95-b1ae2d199cf2 req-dc2c8b50-19d8-466b-94cc-087445615b40 service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received event network-vif-deleted-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:39:52 user nova-compute[73012]: INFO nova.compute.manager [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Took 0.74 seconds to detach 1 volumes for instance.
Aug 14 12:39:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:39:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:39:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-1d32639b-a467-41cd-b3d0-eedd79f61991 req-9595315c-67fd-4f2c-a2b7-e74c47e9ba2b service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received event network-vif-plugged-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:39:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1d32639b-a467-41cd-b3d0-eedd79f61991 req-9595315c-67fd-4f2c-a2b7-e74c47e9ba2b service nova] Acquiring lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:39:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1d32639b-a467-41cd-b3d0-eedd79f61991 req-9595315c-67fd-4f2c-a2b7-e74c47e9ba2b service nova] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:39:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1d32639b-a467-41cd-b3d0-eedd79f61991 req-9595315c-67fd-4f2c-a2b7-e74c47e9ba2b service nova] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:39:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-1d32639b-a467-41cd-b3d0-eedd79f61991 req-9595315c-67fd-4f2c-a2b7-e74c47e9ba2b service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] No waiting events found dispatching network-vif-plugged-e7787e55-f462-4181-8fde-df929ec64ae6 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:39:52 user nova-compute[73012]: WARNING nova.compute.manager [req-1d32639b-a467-41cd-b3d0-eedd79f61991 req-9595315c-67fd-4f2c-a2b7-e74c47e9ba2b service nova] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Received unexpected event network-vif-plugged-e7787e55-f462-4181-8fde-df929ec64ae6 for instance with vm_state deleted and task_state None.
Aug 14 12:39:52 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:39:52 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:39:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:39:52 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Deleted allocations for instance cc5b695c-5e83-4476-b37a-93e7d59a73ff
Aug 14 12:39:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-05bcf243-3bbd-479b-a863-9ad4a1c35afd tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "cc5b695c-5e83-4476-b37a-93e7d59a73ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:39:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:39:54 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:39:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:39:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:39:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:39:54 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:39:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:54 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:39:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:39:56 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:39:56 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8318MB free_disk=25.338138580322266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 4cfcbac9-7014-48b4-a131-2c1b83838a4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 0748d973-3d1f-4197-b850-4cf6b5ab23b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance b8496a99-5a43-4042-9a89-2b17071d68ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 74e0cd5d-680e-4139-9f52-b6cb392160fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:39:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:39:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:39:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:39:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:39:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:39:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:39:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:39:58 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Updating instance_info_cache with network_info: [{"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:39:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-0748d973-3d1f-4197-b850-4cf6b5ab23b4" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:39:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:39:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:39:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:39:59 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:40:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:40:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:40:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:40:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-90a4c726-acf0-4657-b8e9-ba21968fd4a2 req-4ec0ca5d-5a01-4f7c-a048-49172b5fb782 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-changed-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:04 user nova-compute[73012]: DEBUG nova.compute.manager [req-90a4c726-acf0-4657-b8e9-ba21968fd4a2 req-4ec0ca5d-5a01-4f7c-a048-49172b5fb782 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Refreshing instance network info cache due to event network-changed-b60283be-1efe-48ab-b0fd-219cca611193. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:40:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-90a4c726-acf0-4657-b8e9-ba21968fd4a2 req-4ec0ca5d-5a01-4f7c-a048-49172b5fb782 service nova] Acquiring lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:40:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-90a4c726-acf0-4657-b8e9-ba21968fd4a2 req-4ec0ca5d-5a01-4f7c-a048-49172b5fb782 service nova] Acquired lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:40:04 user nova-compute[73012]: DEBUG nova.network.neutron [req-90a4c726-acf0-4657-b8e9-ba21968fd4a2 req-4ec0ca5d-5a01-4f7c-a048-49172b5fb782 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Refreshing network info cache for port b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:40:04 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:40:04 user nova-compute[73012]: DEBUG nova.network.neutron [req-90a4c726-acf0-4657-b8e9-ba21968fd4a2 req-4ec0ca5d-5a01-4f7c-a048-49172b5fb782 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updated VIF entry in instance network info cache for port b60283be-1efe-48ab-b0fd-219cca611193. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:40:04 user nova-compute[73012]: DEBUG nova.network.neutron [req-90a4c726-acf0-4657-b8e9-ba21968fd4a2 req-4ec0ca5d-5a01-4f7c-a048-49172b5fb782 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updating instance_info_cache with network_info: [{"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:40:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-90a4c726-acf0-4657-b8e9-ba21968fd4a2 req-4ec0ca5d-5a01-4f7c-a048-49172b5fb782 service nova] Releasing lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:40:05 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016790.6220083, cc5b695c-5e83-4476-b37a-93e7d59a73ff => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:40:05 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] VM Stopped (Lifecycle Event)
Aug 14 12:40:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-19446696-9fe7-4dfc-baca-d45697a25430 None None] [instance: cc5b695c-5e83-4476-b37a-93e7d59a73ff] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:40:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG nova.objects.instance [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'flavor' on Instance uuid b8496a99-5a43-4042-9a89-2b17071d68ff {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:09 user nova-compute[73012]: INFO nova.compute.manager [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Attaching volume 426226d1-1c78-4cb8-a170-22488b771ba1 to /dev/vdb
Aug 14 12:40:09 user nova-compute[73012]: DEBUG os_brick.utils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f202f2-02fe-4ae6-a41a-d5eecfc4ad15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e796da36-cf23-4e27-abf7-da9d04c81377]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b8634-d018-4493-97f8-144b61e578bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5346f4-3dd4-4005-b71d-a8c7bbb74b6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:40:09 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:40:09 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc7b97e-448e-4efb-85ab-19db2b4e5bdc]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG os_brick.utils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:40:09 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updating existing volume attachment record: edf1362d-8383-4953-ad66-b5212c7b96af {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:40:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:40:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJjudmCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:40:18 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:40:18 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:40:18 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e25256b-4943-4d81-8341-8567c3cb8bd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:40:18 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dc7ca9-5a0f-491e-aa4e-48395cf5e4d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1] added
Aug 14 12:40:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b43f92-1d53-4919-abdc-fba9736fef38]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc2d161-1da8-4a69-a3b9-9d830355488d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJjudmCM {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJjudmCM" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec502c-9e4a-4665-9704-a32ab283162d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SJjudmCM'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ffdc1-979a-4574-8ee9-d547b24162c0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92b0473-ca3a-4ea3-a442-e53e7daa5a21]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:18 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:40:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:18 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:40:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3b30fb-1334-4e85-ba06-6c430f5a862f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1, portal: 172.16.0.220,3260]
Aug 14 12:40:18 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1, portal: 172.16.0.220,3260] successful.
Aug 14 12:40:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd79b9a-ca6c-4357-9404-d9a7632ca781]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[da331e72-e5ea-4e2d-a55b-58039d169e89]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:18 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:40:18 user nova-compute[73012]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 (non-flash)
Aug 14 12:40:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:18 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:40:18 user nova-compute[73012]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 (non-flash)
Aug 14 12:40:18 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4279d8fe-4fa4-4fd8-8001-43f09e6afb15]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:40:18 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJjudmCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:40:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:40:19 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23331643637656539', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:40:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331643637656539', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:40:19 user nova-compute[73012]: DEBUG nova.objects.instance [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'flavor' on Instance uuid b8496a99-5a43-4042-9a89-2b17071d68ff {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:40:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:40:19 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:40:19 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:40:19 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:40:19 user nova-compute[73012]:   <serial>426226d1-1c78-4cb8-a170-22488b771ba1</serial>
Aug 14 12:40:19 user nova-compute[73012]: </disk>
Aug 14 12:40:19 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:40:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:40:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:40:19 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] No VIF found with MAC fa:16:3e:7a:3c:ff, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:40:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b5b20753-257a-4562-b7d5-bf47c1270471 tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.828s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:21 user nova-compute[73012]: INFO nova.compute.manager [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Detaching volume 426226d1-1c78-4cb8-a170-22488b771ba1
Aug 14 12:40:21 user nova-compute[73012]: INFO nova.virt.block_device [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Attempting to driver detach volume 426226d1-1c78-4cb8-a170-22488b771ba1 from mountpoint /dev/vdb
Aug 14 12:40:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Attempting to detach device vdb from instance b8496a99-5a43-4042-9a89-2b17071d68ff from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:40:21 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:40:21 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:40:21 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:40:21 user nova-compute[73012]:   <serial>426226d1-1c78-4cb8-a170-22488b771ba1</serial>
Aug 14 12:40:21 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:40:21 user nova-compute[73012]: </disk>
Aug 14 12:40:21 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:40:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully detached device vdb from instance b8496a99-5a43-4042-9a89-2b17071d68ff from the persistent domain config.
Aug 14 12:40:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8496a99-5a43-4042-9a89-2b17071d68ff from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:40:21 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:40:21 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:40:21 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:40:21 user nova-compute[73012]:   <serial>426226d1-1c78-4cb8-a170-22488b771ba1</serial>
Aug 14 12:40:21 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:40:21 user nova-compute[73012]: </disk>
Aug 14 12:40:21 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692016821.8543527, b8496a99-5a43-4042-9a89-2b17071d68ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8496a99-5a43-4042-9a89-2b17071d68ff {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:40:21 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully detached device vdb from instance b8496a99-5a43-4042-9a89-2b17071d68ff from the live domain config.
Aug 14 12:40:21 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJjudmCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:40:21 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2520bbef-f74c-4c16-a467-64e8e3e6a3da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ae26c5-231b-4b03-9b6d-f8763e9dc676]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:21 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:40:21 user nova-compute[73012]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 (non-flash)
Aug 14 12:40:21 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:21 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:40:21 user nova-compute[73012]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 (non-flash)
Aug 14 12:40:21 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad016acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[adddfd4c-5081-46e9-a747-5a2b777c905f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac777ab-a0eb-42f4-8b33-b4415f22307c]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d874e3-a111-41db-b829-29b87be12dc8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:40:21 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b3002-e51e-4ed0-93a9-1f24d68d3c87]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbdc473-041d-4f52-b22d-34f193df461e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[620dca8f-bda3-48d5-b5b7-fa6e66cc0337]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1, portal: 172.16.0.220,3260]
Aug 14 12:40:22 user nova-compute[73012]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1, portal: 172.16.0.220,3260] successful.
Aug 14 12:40:22 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:426226d1-1c78-4cb8-a170-22488b771ba1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e70678-b687-4a2b-b591-7c58702b31d2]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] <== disconnect_volume: return (271ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'flavor' on Instance uuid b8496a99-5a43-4042-9a89-2b17071d68ff {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:40:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f04e34d3-f543-4a77-b1a6-c2339483a4ca tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.557s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:25 user nova-compute[73012]: INFO nova.compute.manager [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Detaching volume 629e79e2-60ab-4de5-add8-a7a637f8a13c
Aug 14 12:40:25 user nova-compute[73012]: INFO nova.virt.block_device [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Attempting to driver detach volume 629e79e2-60ab-4de5-add8-a7a637f8a13c from mountpoint /dev/vdb
Aug 14 12:40:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Attempting to detach device vdb from instance 0748d973-3d1f-4197-b850-4cf6b5ab23b4 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:40:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:40:25 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:40:25 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:40:25 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:40:25 user nova-compute[73012]:   <serial>629e79e2-60ab-4de5-add8-a7a637f8a13c</serial>
Aug 14 12:40:25 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:40:25 user nova-compute[73012]: </disk>
Aug 14 12:40:25 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:40:25 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Successfully detached device vdb from instance 0748d973-3d1f-4197-b850-4cf6b5ab23b4 from the persistent domain config.
Aug 14 12:40:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0748d973-3d1f-4197-b850-4cf6b5ab23b4 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:40:25 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:40:25 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:40:25 user nova-compute[73012]:   <source dev="/dev/sdd"/>
Aug 14 12:40:25 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:40:25 user nova-compute[73012]:   <serial>629e79e2-60ab-4de5-add8-a7a637f8a13c</serial>
Aug 14 12:40:25 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:40:25 user nova-compute[73012]: </disk>
Aug 14 12:40:25 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692016826.4724207, 0748d973-3d1f-4197-b850-4cf6b5ab23b4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0748d973-3d1f-4197-b850-4cf6b5ab23b4 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:40:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Successfully detached device vdb from instance 0748d973-3d1f-4197-b850-4cf6b5ab23b4 from the live domain config.
Aug 14 12:40:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWaMXUkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:40:26 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8f37cb-e1c4-4d7b-98dd-7d8d4c339b09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b47ef2-810c-4045-9692-bad5a727e0c7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:26 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:40:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:26 user nova-compute[73012]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c (non-flash)
Aug 14 12:40:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0149f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c'): ({'sdd'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Removing single pathed devices sdd {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ad416a-152d-4e8b-8557-08b0c13ff9f8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b55de64-2d06-44bf-9dab-a205aa2bf83a]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Flushing IO for device /dev/sdd {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e38075-dc99-4b8b-925c-c0246d2737b0]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a442cf2f-44ab-4328-838b-37c5b1001014]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] SCSI volumes sdd have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[085e8279-9151-4548-b437-fe58753ded2b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e47971-d1a5-4930-bd06-0e94bd7f3f9c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c, portal: 172.16.0.220,3260]
Aug 14 12:40:26 user nova-compute[73012]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c, portal: 172.16.0.220,3260] successful.
Aug 14 12:40:26 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b576762-eb90-40db-9cf6-b7c428d67969]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] <== disconnect_volume: return (253ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:40:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'flavor' on Instance uuid 0748d973-3d1f-4197-b850-4cf6b5ab23b4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ee3e66ec-4e13-4c52-b40b-056ce8506890 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.575s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.464s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:27 user nova-compute[73012]: INFO nova.compute.manager [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Terminating instance
Aug 14 12:40:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-ff2493d2-248b-4c33-a019-d4a0f1eb38b6 req-20a8d926-b44d-4264-b652-3bdaed858c49 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received event network-vif-unplugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ff2493d2-248b-4c33-a019-d4a0f1eb38b6 req-20a8d926-b44d-4264-b652-3bdaed858c49 service nova] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ff2493d2-248b-4c33-a019-d4a0f1eb38b6 req-20a8d926-b44d-4264-b652-3bdaed858c49 service nova] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ff2493d2-248b-4c33-a019-d4a0f1eb38b6 req-20a8d926-b44d-4264-b652-3bdaed858c49 service nova] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-ff2493d2-248b-4c33-a019-d4a0f1eb38b6 req-20a8d926-b44d-4264-b652-3bdaed858c49 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] No waiting events found dispatching network-vif-unplugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:40:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-ff2493d2-248b-4c33-a019-d4a0f1eb38b6 req-20a8d926-b44d-4264-b652-3bdaed858c49 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received event network-vif-unplugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:40:28 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Instance destroyed successfully.
Aug 14 12:40:28 user nova-compute[73012]: DEBUG nova.objects.instance [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'resources' on Instance uuid 0748d973-3d1f-4197-b850-4cf6b5ab23b4 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:37:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1361413395',display_name='tempest-VolumesSnapshotTestJSON-instance-1361413395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1361413395',id=45,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3nsdvplYJspUvoSunyIxuQP/2r+TCzWptVLygFrnDvDpU6GB1Cj6EtPQDCCZv+WUZodeWA17255o1QF2NUhjxZArZ3ySRTmoqt63YZqNujK0NLwum6vZ872gAFkFWblQ==',key_name='tempest-keypair-2078311329',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:37:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ab505f398334cd695ac16793ab4b7c9',ramdisk_id='',reservation_id='r-cht27ck1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1686077578',owner_user_name='tempest-VolumesSnapshotTestJSON-1686077578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feaad28b32a4769acbbc87598f0da59',uuid=0748d973-3d1f-4197-b850-4cf6b5ab23b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converting VIF {"id": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "address": "fa:16:3e:33:fb:4b", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd3ce9bb-89", "ovs_interfaceid": "fd3ce9bb-890e-49d5-86d2-63a74da9b54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=fd3ce9bb-890e-49d5-86d2-63a74da9b54d,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd3ce9bb-89') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_vif [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=fd3ce9bb-890e-49d5-86d2-63a74da9b54d,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd3ce9bb-89') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd3ce9bb-89, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:40:28 user nova-compute[73012]: INFO os_vif [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=fd3ce9bb-890e-49d5-86d2-63a74da9b54d,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd3ce9bb-89')
Aug 14 12:40:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWaMXUkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:40:28 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:629e79e2-60ab-4de5-add8-a7a637f8a13c', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdbccbc-3e77-4629-90a1-d458cc7a3b08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f137d3e1-f9e1-4f54-a1d3-1f6771568fe0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad013dd80>, {}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Disconnecting from: [] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] <== disconnect_volume: return (57ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:40:28 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Deleting instance files /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4_del
Aug 14 12:40:28 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Deletion of /opt/stack/data/nova/instances/0748d973-3d1f-4197-b850-4cf6b5ab23b4_del complete
Aug 14 12:40:28 user nova-compute[73012]: INFO nova.compute.manager [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 12:40:28 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:40:28 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:40:29 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:40:29 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Took 0.77 seconds to deallocate network for instance.
Aug 14 12:40:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-2f9c31d6-2a30-4668-aed7-5b46c0daebd0 req-d127cb08-024f-4e8f-aaaf-66c86de6af42 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received event network-vif-deleted-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:29 user nova-compute[73012]: WARNING nova.volume.cinder [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Attachment 697ab820-4d00-4313-a01e-c939d8b3625f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 697ab820-4d00-4313-a01e-c939d8b3625f. (HTTP 404) (Request-ID: req-60376d1b-f696-49b3-9833-a01089bfb13e)
Aug 14 12:40:29 user nova-compute[73012]: INFO nova.compute.manager [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Took 0.02 seconds to detach 1 volumes for instance.
Aug 14 12:40:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:29 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:40:29 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:40:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:29 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Deleted allocations for instance 0748d973-3d1f-4197-b850-4cf6b5ab23b4
Aug 14 12:40:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-cf47f63d-7176-43d0-a7a4-341a708c96eb req-9aac1287-537f-4845-975b-4fb0c7a24115 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received event network-vif-plugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cf47f63d-7176-43d0-a7a4-341a708c96eb req-9aac1287-537f-4845-975b-4fb0c7a24115 service nova] Acquiring lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cf47f63d-7176-43d0-a7a4-341a708c96eb req-9aac1287-537f-4845-975b-4fb0c7a24115 service nova] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cf47f63d-7176-43d0-a7a4-341a708c96eb req-9aac1287-537f-4845-975b-4fb0c7a24115 service nova] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-cf47f63d-7176-43d0-a7a4-341a708c96eb req-9aac1287-537f-4845-975b-4fb0c7a24115 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] No waiting events found dispatching network-vif-plugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:40:29 user nova-compute[73012]: WARNING nova.compute.manager [req-cf47f63d-7176-43d0-a7a4-341a708c96eb req-9aac1287-537f-4845-975b-4fb0c7a24115 service nova] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Received unexpected event network-vif-plugged-fd3ce9bb-890e-49d5-86d2-63a74da9b54d for instance with vm_state deleted and task_state None.
Aug 14 12:40:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1d3b449c-d510-45d3-890f-95c7e5b6a23f tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "0748d973-3d1f-4197-b850-4cf6b5ab23b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquiring lock "74e0cd5d-680e-4139-9f52-b6cb392160fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquiring lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:40 user nova-compute[73012]: INFO nova.compute.manager [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Terminating instance
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-0ace01a1-3908-4dfc-8c50-6106fa180b1e req-c9f0c277-b01b-4f80-a7f9-4c3656abd51a service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received event network-vif-unplugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0ace01a1-3908-4dfc-8c50-6106fa180b1e req-c9f0c277-b01b-4f80-a7f9-4c3656abd51a service nova] Acquiring lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0ace01a1-3908-4dfc-8c50-6106fa180b1e req-c9f0c277-b01b-4f80-a7f9-4c3656abd51a service nova] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-0ace01a1-3908-4dfc-8c50-6106fa180b1e req-c9f0c277-b01b-4f80-a7f9-4c3656abd51a service nova] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-0ace01a1-3908-4dfc-8c50-6106fa180b1e req-c9f0c277-b01b-4f80-a7f9-4c3656abd51a service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] No waiting events found dispatching network-vif-unplugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-0ace01a1-3908-4dfc-8c50-6106fa180b1e req-c9f0c277-b01b-4f80-a7f9-4c3656abd51a service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received event network-vif-unplugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:40:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Instance destroyed successfully.
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.objects.instance [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lazy-loading 'resources' on Instance uuid 74e0cd5d-680e-4139-9f52-b6cb392160fc {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1047377860',display_name='tempest-VolumesActionsTest-instance-1047377860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1047377860',id=48,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:38:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0219e3b5ebdd47939139a6b797184ea7',ramdisk_id='',reservation_id='r-5wadlw1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1733823408',owner_user_name='tempest-VolumesActionsTest-1733823408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:38:46Z,user_data=None,user_id='0f4144ed51954006a6d7c893be2d6e33',uuid=74e0cd5d-680e-4139-9f52-b6cb392160fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Converting VIF {"id": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "address": "fa:16:3e:39:a9:5a", "network": {"id": "2cc3b568-36b5-43a9-b26d-64090a639722", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1539404908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0219e3b5ebdd47939139a6b797184ea7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd72ed4f0-11", "ovs_interfaceid": "d72ed4f0-1149-4d0a-bf1d-5325d7983152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=d72ed4f0-1149-4d0a-bf1d-5325d7983152,network=Network(2cc3b568-36b5-43a9-b26d-64090a639722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72ed4f0-11') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG os_vif [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=d72ed4f0-1149-4d0a-bf1d-5325d7983152,network=Network(2cc3b568-36b5-43a9-b26d-64090a639722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72ed4f0-11') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd72ed4f0-11, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:40:40 user nova-compute[73012]: INFO os_vif [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=d72ed4f0-1149-4d0a-bf1d-5325d7983152,network=Network(2cc3b568-36b5-43a9-b26d-64090a639722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd72ed4f0-11')
Aug 14 12:40:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Deleting instance files /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc_del
Aug 14 12:40:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Deletion of /opt/stack/data/nova/instances/74e0cd5d-680e-4139-9f52-b6cb392160fc_del complete
Aug 14 12:40:40 user nova-compute[73012]: INFO nova.compute.manager [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 14 12:40:40 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:40:40 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:40:41 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:40:41 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Took 0.52 seconds to deallocate network for instance.
Aug 14 12:40:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:41 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:40:41 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:40:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:41 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Deleted allocations for instance 74e0cd5d-680e-4139-9f52-b6cb392160fc
Aug 14 12:40:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ce4c064-cd05-4035-8da5-73052e6852b8 tempest-VolumesActionsTest-1733823408 tempest-VolumesActionsTest-1733823408-project-member] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.733s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-393cb9f4-f8d0-4bfc-a673-93085c9ba187 req-2b33b47c-58c9-463f-a9a9-361419384014 service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received event network-vif-plugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-393cb9f4-f8d0-4bfc-a673-93085c9ba187 req-2b33b47c-58c9-463f-a9a9-361419384014 service nova] Acquiring lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-393cb9f4-f8d0-4bfc-a673-93085c9ba187 req-2b33b47c-58c9-463f-a9a9-361419384014 service nova] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-393cb9f4-f8d0-4bfc-a673-93085c9ba187 req-2b33b47c-58c9-463f-a9a9-361419384014 service nova] Lock "74e0cd5d-680e-4139-9f52-b6cb392160fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-393cb9f4-f8d0-4bfc-a673-93085c9ba187 req-2b33b47c-58c9-463f-a9a9-361419384014 service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] No waiting events found dispatching network-vif-plugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:40:42 user nova-compute[73012]: WARNING nova.compute.manager [req-393cb9f4-f8d0-4bfc-a673-93085c9ba187 req-2b33b47c-58c9-463f-a9a9-361419384014 service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received unexpected event network-vif-plugged-d72ed4f0-1149-4d0a-bf1d-5325d7983152 for instance with vm_state deleted and task_state None.
Aug 14 12:40:42 user nova-compute[73012]: DEBUG nova.compute.manager [req-393cb9f4-f8d0-4bfc-a673-93085c9ba187 req-2b33b47c-58c9-463f-a9a9-361419384014 service nova] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Received event network-vif-deleted-d72ed4f0-1149-4d0a-bf1d-5325d7983152 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:43 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016828.2505972, 0748d973-3d1f-4197-b850-4cf6b5ab23b4 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:40:43 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] VM Stopped (Lifecycle Event)
Aug 14 12:40:43 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1e9cfdca-9818-4c4d-9ca2-3686eb719b5a None None] [instance: 0748d973-3d1f-4197-b850-4cf6b5ab23b4] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:40:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:40:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:40:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:40:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:40:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-d5d93c31-09aa-4975-88eb-2aa12f782719 req-c8a00224-1d0a-4de4-ac1b-926e325d69e3 service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received event network-changed-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG nova.compute.manager [req-d5d93c31-09aa-4975-88eb-2aa12f782719 req-c8a00224-1d0a-4de4-ac1b-926e325d69e3 service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Refreshing instance network info cache due to event network-changed-d473651f-b160-4ae5-a077-6b0819e9cbcb. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d5d93c31-09aa-4975-88eb-2aa12f782719 req-c8a00224-1d0a-4de4-ac1b-926e325d69e3 service nova] Acquiring lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d5d93c31-09aa-4975-88eb-2aa12f782719 req-c8a00224-1d0a-4de4-ac1b-926e325d69e3 service nova] Acquired lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG nova.network.neutron [req-d5d93c31-09aa-4975-88eb-2aa12f782719 req-c8a00224-1d0a-4de4-ac1b-926e325d69e3 service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Refreshing network info cache for port d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:51 user nova-compute[73012]: INFO nova.compute.manager [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Terminating instance
Aug 14 12:40:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.network.neutron [req-d5d93c31-09aa-4975-88eb-2aa12f782719 req-c8a00224-1d0a-4de4-ac1b-926e325d69e3 service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updated VIF entry in instance network info cache for port d473651f-b160-4ae5-a077-6b0819e9cbcb. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.network.neutron [req-d5d93c31-09aa-4975-88eb-2aa12f782719 req-c8a00224-1d0a-4de4-ac1b-926e325d69e3 service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updating instance_info_cache with network_info: [{"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-d5d93c31-09aa-4975-88eb-2aa12f782719 req-c8a00224-1d0a-4de4-ac1b-926e325d69e3 service nova] Releasing lock "refresh_cache-4cfcbac9-7014-48b4-a131-2c1b83838a4b" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-a60e6300-9a72-4b88-acea-2a6bd0ea7c42 req-38c19e97-88bb-4ac7-b02c-b891b853f75e service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received event network-vif-unplugged-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a60e6300-9a72-4b88-acea-2a6bd0ea7c42 req-38c19e97-88bb-4ac7-b02c-b891b853f75e service nova] Acquiring lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a60e6300-9a72-4b88-acea-2a6bd0ea7c42 req-38c19e97-88bb-4ac7-b02c-b891b853f75e service nova] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a60e6300-9a72-4b88-acea-2a6bd0ea7c42 req-38c19e97-88bb-4ac7-b02c-b891b853f75e service nova] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-a60e6300-9a72-4b88-acea-2a6bd0ea7c42 req-38c19e97-88bb-4ac7-b02c-b891b853f75e service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] No waiting events found dispatching network-vif-unplugged-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.compute.manager [req-a60e6300-9a72-4b88-acea-2a6bd0ea7c42 req-38c19e97-88bb-4ac7-b02c-b891b853f75e service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received event network-vif-unplugged-d473651f-b160-4ae5-a077-6b0819e9cbcb for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:40:52 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Instance destroyed successfully.
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lazy-loading 'resources' on Instance uuid 4cfcbac9-7014-48b4-a131-2c1b83838a4b {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-95293580',display_name='tempest-TestVolumeBootPattern-server-95293580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-95293580',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNg7lN4gu0O9CJgDpyBhy0RX3jSYGXDmrd1kKjcONe+vy3hXe0gfOqavEjgU06+fs+8PvDAL8t8WC3udIvRk5S68ldJhrYI9gy8tZpcPsibRZmE5rDqMVaBs/gzMf1AsPA==',key_name='tempest-TestVolumeBootPattern-1852675789',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:36:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7699b5c3fcc34a619e5d0d066e8ff642',ramdisk_id='',reservation_id='r-g17bb11f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1572075418',owner_user_name='tempest-TestVolumeBootPattern-1572075418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:36:16Z,user_data=None,user_id='0311f0fd37f143739604c409233537fa',uuid=4cfcbac9-7014-48b4-a131-2c1b83838a4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converting VIF {"id": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "address": "fa:16:3e:5f:da:0e", "network": {"id": "930f8d59-b078-4d8b-ab4a-65bde22c3c7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2043864622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7699b5c3fcc34a619e5d0d066e8ff642", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd473651f-b1", "ovs_interfaceid": "d473651f-b160-4ae5-a077-6b0819e9cbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:da:0e,bridge_name='br-int',has_traffic_filtering=True,id=d473651f-b160-4ae5-a077-6b0819e9cbcb,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd473651f-b1') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_vif [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:da:0e,bridge_name='br-int',has_traffic_filtering=True,id=d473651f-b160-4ae5-a077-6b0819e9cbcb,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd473651f-b1') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd473651f-b1, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:52 user nova-compute[73012]: INFO os_vif [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:da:0e,bridge_name='br-int',has_traffic_filtering=True,id=d473651f-b160-4ae5-a077-6b0819e9cbcb,network=Network(930f8d59-b078-4d8b-ab4a-65bde22c3c7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd473651f-b1')
Aug 14 12:40:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyeaRgFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:40:52 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1c7997-cc59-42cb-a975-36f7bd4d3e50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[045eb305-ee8f-4864-bd22-f27a35c898be]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:52 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 (non-flash)
Aug 14 12:40:52 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aacf2d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6a42a9-df01-49fe-9d4b-8d7479051ff5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1173ede9-d99a-471c-916b-d5f33f152574]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e64c36d-8541-424a-b962-9a3128f6e325]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d9a37c-e2e7-480f-81ee-d8c170ac1db3]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23132363736383832', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bfa8fb48', '/dev/disk/by-id/scsi-1SCST_BIObfa8fb48-126768823d60d1f5') {{(pid=84070) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f8d1d3-f71d-40b3-9e16-f915cffa93e9]: (4, None) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f11a0a-fb36-4c2e-91d4-f135ea5a8427]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[66379b88-d630-4d42-8cfd-a5c4363e3c9a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260]
Aug 14 12:40:53 user nova-compute[73012]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2, portal: 172.16.0.220,3260] successful.
Aug 14 12:40:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03cff6c0-a19c-4526-9143-3edac05caef2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a13739-1a88-4e39-9535-bba7d960c63c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] <== disconnect_volume: return (281ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:40:53 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Deleting instance files /opt/stack/data/nova/instances/4cfcbac9-7014-48b4-a131-2c1b83838a4b_del
Aug 14 12:40:53 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Deletion of /opt/stack/data/nova/instances/4cfcbac9-7014-48b4-a131-2c1b83838a4b_del complete
Aug 14 12:40:53 user nova-compute[73012]: INFO nova.compute.manager [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 14 12:40:53 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:40:53 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:40:53 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Took 0.50 seconds to deallocate network for instance.
Aug 14 12:40:53 user nova-compute[73012]: DEBUG nova.compute.manager [req-71ae1a30-276a-4aef-80e3-30552651436f req-abd69c43-bb34-4f86-b02c-746febcb66fa service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received event network-vif-deleted-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:54 user nova-compute[73012]: INFO nova.compute.manager [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Took 0.79 seconds to detach 1 volumes for instance.
Aug 14 12:40:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:54 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:40:54 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:40:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:54 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Deleted allocations for instance 4cfcbac9-7014-48b4-a131-2c1b83838a4b
Aug 14 12:40:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e456caaf-60ac-45f2-a265-5a78ffd4b7a7 tempest-TestVolumeBootPattern-1572075418 tempest-TestVolumeBootPattern-1572075418-project-member] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.696s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-2e29b3ab-e27e-4339-bb80-8e069d3b4187 req-17d0ba0b-9713-42aa-8865-3b5fdcff69fb service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received event network-vif-plugged-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:40:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2e29b3ab-e27e-4339-bb80-8e069d3b4187 req-17d0ba0b-9713-42aa-8865-3b5fdcff69fb service nova] Acquiring lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2e29b3ab-e27e-4339-bb80-8e069d3b4187 req-17d0ba0b-9713-42aa-8865-3b5fdcff69fb service nova] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-2e29b3ab-e27e-4339-bb80-8e069d3b4187 req-17d0ba0b-9713-42aa-8865-3b5fdcff69fb service nova] Lock "4cfcbac9-7014-48b4-a131-2c1b83838a4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-2e29b3ab-e27e-4339-bb80-8e069d3b4187 req-17d0ba0b-9713-42aa-8865-3b5fdcff69fb service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] No waiting events found dispatching network-vif-plugged-d473651f-b160-4ae5-a077-6b0819e9cbcb {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:40:54 user nova-compute[73012]: WARNING nova.compute.manager [req-2e29b3ab-e27e-4339-bb80-8e069d3b4187 req-17d0ba0b-9713-42aa-8865-3b5fdcff69fb service nova] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Received unexpected event network-vif-plugged-d473651f-b160-4ae5-a077-6b0819e9cbcb for instance with vm_state deleted and task_state None.
Aug 14 12:40:55 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016840.554646, 74e0cd5d-680e-4139-9f52-b6cb392160fc => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:40:55 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] VM Stopped (Lifecycle Event)
Aug 14 12:40:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-2ce2e01e-e341-4dda-a453-d8b4a7c4343b None None] [instance: 74e0cd5d-680e-4139-9f52-b6cb392160fc] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:40:55 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:40:56 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:40:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:56 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:40:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:56 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:40:57 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:40:57 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:40:57 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8629MB free_disk=25.391624450683594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance b8496a99-5a43-4042-9a89-2b17071d68ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:40:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:40:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:40:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:40:58 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:40:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:40:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:40:58 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:40:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updating instance_info_cache with network_info: [{"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:40:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-b8496a99-5a43-4042-9a89-2b17071d68ff" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:40:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:40:59 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:40:59 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:00 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:41:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:41:05 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:07 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016852.7224364, 4cfcbac9-7014-48b4-a131-2c1b83838a4b => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:41:07 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] VM Stopped (Lifecycle Event)
Aug 14 12:41:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e16eb111-6f21-422f-9732-f528df1a0d88 None None] [instance: 4cfcbac9-7014-48b4-a131-2c1b83838a4b] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:41:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:11 user nova-compute[73012]: INFO nova.compute.manager [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Terminating instance
Aug 14 12:41:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-1b61c839-82c1-4ecc-a498-78beb46c7548 req-abcf822a-31c4-4489-8749-2166b3be6a69 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-unplugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1b61c839-82c1-4ecc-a498-78beb46c7548 req-abcf822a-31c4-4489-8749-2166b3be6a69 service nova] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1b61c839-82c1-4ecc-a498-78beb46c7548 req-abcf822a-31c4-4489-8749-2166b3be6a69 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-1b61c839-82c1-4ecc-a498-78beb46c7548 req-abcf822a-31c4-4489-8749-2166b3be6a69 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-1b61c839-82c1-4ecc-a498-78beb46c7548 req-abcf822a-31c4-4489-8749-2166b3be6a69 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] No waiting events found dispatching network-vif-unplugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:41:11 user nova-compute[73012]: DEBUG nova.compute.manager [req-1b61c839-82c1-4ecc-a498-78beb46c7548 req-abcf822a-31c4-4489-8749-2166b3be6a69 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-unplugged-b60283be-1efe-48ab-b0fd-219cca611193 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Instance destroyed successfully.
Aug 14 12:41:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lazy-loading 'resources' on Instance uuid b8496a99-5a43-4042-9a89-2b17071d68ff {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-903267946',display_name='tempest-AttachVolumeNegativeTest-server-903267946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-903267946',id=47,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD59CJgosnYdsd1Kev/Fil/p9WwvCGySwm7nji60N8Ub2ymjIyZAIW808AF94s7Kaw9qFTmXuddOjeMCG5ZJBDixCnIWFf4q5xXpM/jhiDHQsapC/ZI+1cUTlClIGWem+w==',key_name='tempest-keypair-808117168',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:38:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bef9274d18f04a30bb977bb9ef163bc5',ramdisk_id='',reservation_id='r-v5vw0m09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1684368273',owner_user_name='tempest-AttachVolumeNegativeTest-1684368273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbc96fd6e33b4e4aae1de009a457c08a',uuid=b8496a99-5a43-4042-9a89-2b17071d68ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converting VIF {"id": "b60283be-1efe-48ab-b0fd-219cca611193", "address": "fa:16:3e:7a:3c:ff", "network": {"id": "9e9f9a94-deb2-4d21-b105-15fc3a3b6acf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045967987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef9274d18f04a30bb977bb9ef163bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60283be-1e", "ovs_interfaceid": "b60283be-1efe-48ab-b0fd-219cca611193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b60283be-1efe-48ab-b0fd-219cca611193,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60283be-1e') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG os_vif [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b60283be-1efe-48ab-b0fd-219cca611193,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60283be-1e') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb60283be-1e, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:41:12 user nova-compute[73012]: INFO os_vif [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b60283be-1efe-48ab-b0fd-219cca611193,network=Network(9e9f9a94-deb2-4d21-b105-15fc3a3b6acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60283be-1e')
Aug 14 12:41:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Deleting instance files /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff_del
Aug 14 12:41:12 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Deletion of /opt/stack/data/nova/instances/b8496a99-5a43-4042-9a89-2b17071d68ff_del complete
Aug 14 12:41:12 user nova-compute[73012]: INFO nova.compute.manager [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 12:41:12 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:41:12 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:41:13 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Took 1.25 seconds to deallocate network for instance.
Aug 14 12:41:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-92d31eb3-ef1b-4b2c-a699-51f79485c3c3 req-fd9a1d59-7eec-4a35-8bb0-eb862de1f56d service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-deleted-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:13 user nova-compute[73012]: INFO nova.compute.manager [req-92d31eb3-ef1b-4b2c-a699-51f79485c3c3 req-fd9a1d59-7eec-4a35-8bb0-eb862de1f56d service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Neutron deleted interface b60283be-1efe-48ab-b0fd-219cca611193; detaching it from the instance and deleting it from the info cache
Aug 14 12:41:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-92d31eb3-ef1b-4b2c-a699-51f79485c3c3 req-fd9a1d59-7eec-4a35-8bb0-eb862de1f56d service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-92d31eb3-ef1b-4b2c-a699-51f79485c3c3 req-fd9a1d59-7eec-4a35-8bb0-eb862de1f56d service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Detach interface failed, port_id=b60283be-1efe-48ab-b0fd-219cca611193, reason: Instance b8496a99-5a43-4042-9a89-2b17071d68ff could not be found. {{(pid=73012) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:41:13 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] No waiting events found dispatching network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:41:14 user nova-compute[73012]: WARNING nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received unexpected event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 for instance with vm_state deleted and task_state None.
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] No waiting events found dispatching network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:41:14 user nova-compute[73012]: WARNING nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received unexpected event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 for instance with vm_state deleted and task_state None.
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] No waiting events found dispatching network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:41:14 user nova-compute[73012]: WARNING nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received unexpected event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 for instance with vm_state deleted and task_state None.
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-unplugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] No waiting events found dispatching network-vif-unplugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:41:14 user nova-compute[73012]: WARNING nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received unexpected event network-vif-unplugged-b60283be-1efe-48ab-b0fd-219cca611193 for instance with vm_state deleted and task_state None.
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Acquiring lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] No waiting events found dispatching network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:41:14 user nova-compute[73012]: WARNING nova.compute.manager [req-6cd3fdd3-d707-4f6c-a1e9-3ed52c7e0bdf req-876acb86-1261-42db-aac2-407e72a172f2 service nova] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Received unexpected event network-vif-plugged-b60283be-1efe-48ab-b0fd-219cca611193 for instance with vm_state deleted and task_state None.
Aug 14 12:41:14 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Deleted allocations for instance b8496a99-5a43-4042-9a89-2b17071d68ff
Aug 14 12:41:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-7de77aeb-7cf2-44c8-9c1e-eee94b7d6e5e tempest-AttachVolumeNegativeTest-1684368273 tempest-AttachVolumeNegativeTest-1684368273-project-member] Lock "b8496a99-5a43-4042-9a89-2b17071d68ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.456s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Verify base images {{(pid=73012) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 14 12:41:17 user nova-compute[73012]: WARNING nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Unknown base file: /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f
Aug 14 12:41:17 user nova-compute[73012]: WARNING nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Unknown base file: /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd
Aug 14 12:41:17 user nova-compute[73012]: WARNING nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Unknown base file: /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34
Aug 14 12:41:17 user nova-compute[73012]: WARNING nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Unknown base file: /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061
Aug 14 12:41:17 user nova-compute[73012]: WARNING nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Unknown base file: /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c
Aug 14 12:41:17 user nova-compute[73012]: WARNING nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Unknown base file: /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9
Aug 14 12:41:17 user nova-compute[73012]: WARNING nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Unknown base file: /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38
Aug 14 12:41:17 user nova-compute[73012]: WARNING nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Unknown base file: /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd
Aug 14 12:41:17 user nova-compute[73012]: WARNING nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Unknown base file: /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Removable base files: /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34 /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9 /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38 /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/807eddc87bd233fed525e056e54252170e4a118f
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2467686ddece399717ca37387e511b746ff9dcfd
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/67ec011e146d1a61ed0b90b73450546f44089b34
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/490de98d248b2e0bc557596501e403b206bd8b0c
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2f7a2ce59bb0b5cf523817da4b400625e83a38a9
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/65d2a028f2ea6472785e49d63059b5dab1641f38
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/55417786b8b2c01e0bcecf9ff26f783d31cf09bd
Aug 14 12:41:17 user nova-compute[73012]: INFO nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e67e325e06fdad408dbdf5a17c4d29609d943c4a
Aug 14 12:41:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Verification complete {{(pid=73012) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Verify swap images {{(pid=73012) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 14 12:41:17 user nova-compute[73012]: DEBUG nova.virt.libvirt.imagecache [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Verify ephemeral images {{(pid=73012) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 14 12:41:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:41:27 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692016872.459587, b8496a99-5a43-4042-9a89-2b17071d68ff => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:41:27 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] VM Stopped (Lifecycle Event)
Aug 14 12:41:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9158be27-4106-4bf8-9c92-251feff52da3 None None] [instance: b8496a99-5a43-4042-9a89-2b17071d68ff] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:41:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:41:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:41:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:41:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:41:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:41:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:41:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:41:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:41:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:41:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:41:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:41:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:41:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:41:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:42 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:41:52 user nova-compute[73012]: INFO nova.compute.claims [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Claim successful on node user
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.189s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.network.neutron [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:41:52 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.policy [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7feaad28b32a4769acbbc87598f0da59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab505f398334cd695ac16793ab4b7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:41:52 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Creating image(s)
Aug 14 12:41:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "/opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "/opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "/opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:52 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk 1073741824" returned: 0 in 0.065s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG nova.network.neutron [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Successfully created port: 4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Cannot resize image /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG nova.objects.instance [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'migration_context' on Instance uuid 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Ensure instance console log exists: /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:53 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Successfully updated port: 4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:41:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:41:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquired lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:41:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:41:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-fbb6bea5-2ea4-4190-bdf0-43c62a9c0627 req-4bc09f27-5ea0-49ce-be09-6df4c21890f1 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received event network-changed-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:54 user nova-compute[73012]: DEBUG nova.compute.manager [req-fbb6bea5-2ea4-4190-bdf0-43c62a9c0627 req-4bc09f27-5ea0-49ce-be09-6df4c21890f1 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Refreshing instance network info cache due to event network-changed-4bc1ef84-7c83-4ed6-8855-8f41814c441f. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:41:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fbb6bea5-2ea4-4190-bdf0-43c62a9c0627 req-4bc09f27-5ea0-49ce-be09-6df4c21890f1 service nova] Acquiring lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:41:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:41:54 user nova-compute[73012]: DEBUG nova.network.neutron [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updating instance_info_cache with network_info: [{"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Releasing lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Instance network_info: |[{"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fbb6bea5-2ea4-4190-bdf0-43c62a9c0627 req-4bc09f27-5ea0-49ce-be09-6df4c21890f1 service nova] Acquired lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-fbb6bea5-2ea4-4190-bdf0-43c62a9c0627 req-4bc09f27-5ea0-49ce-be09-6df4c21890f1 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Refreshing network info cache for port 4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Start _get_guest_xml network_info=[{"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:41:55 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:41:55 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2066996628',display_name='tempest-VolumesSnapshotTestJSON-instance-2066996628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2066996628',id=49,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPrCIg8n75g8gCQ+iQMNj/R37QmrXcqS4eqw2C2wkfukLaK4+Q3HS3OD5xZAMtyFbczkZR0icyOHKiMIiXC8hktGlcO+TaCO2bw8rk3N92tv3ZvljQqC0YnlwBUFvNgeA==',key_name='tempest-keypair-164325201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ab505f398334cd695ac16793ab4b7c9',ramdisk_id='',reservation_id='r-twangh1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1686077578',owner_user_name='tempest-VolumesSnapshotTestJSON-1686077578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feaad28b32a4769acbbc87598f0da59',uuid=41101a51-ac3f-43a8-b4c3-94d17cb53fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converting VIF {"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:aa:dc,bridge_name='br-int',has_traffic_filtering=True,id=4bc1ef84-7c83-4ed6-8855-8f41814c441f,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc1ef84-7c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.objects.instance [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'pci_devices' on Instance uuid 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:41:55 user nova-compute[73012]:   <uuid>41101a51-ac3f-43a8-b4c3-94d17cb53fea</uuid>
Aug 14 12:41:55 user nova-compute[73012]:   <name>instance-00000031</name>
Aug 14 12:41:55 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:41:55 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:41:55 user nova-compute[73012]:   <metadata>
Aug 14 12:41:55 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:41:55 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:41:55 user nova-compute[73012]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2066996628</nova:name>
Aug 14 12:41:55 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:41:55</nova:creationTime>
Aug 14 12:41:55 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:41:55 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:41:55 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:41:55 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:41:55 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:41:55 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:41:55 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:41:55 user nova-compute[73012]:       <nova:owner>
Aug 14 12:41:55 user nova-compute[73012]:         <nova:user uuid="7feaad28b32a4769acbbc87598f0da59">tempest-VolumesSnapshotTestJSON-1686077578-project-member</nova:user>
Aug 14 12:41:55 user nova-compute[73012]:         <nova:project uuid="1ab505f398334cd695ac16793ab4b7c9">tempest-VolumesSnapshotTestJSON-1686077578</nova:project>
Aug 14 12:41:55 user nova-compute[73012]:       </nova:owner>
Aug 14 12:41:55 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:41:55 user nova-compute[73012]:       <nova:ports>
Aug 14 12:41:55 user nova-compute[73012]:         <nova:port uuid="4bc1ef84-7c83-4ed6-8855-8f41814c441f">
Aug 14 12:41:55 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:41:55 user nova-compute[73012]:         </nova:port>
Aug 14 12:41:55 user nova-compute[73012]:       </nova:ports>
Aug 14 12:41:55 user nova-compute[73012]:     </nova:instance>
Aug 14 12:41:55 user nova-compute[73012]:   </metadata>
Aug 14 12:41:55 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:41:55 user nova-compute[73012]:     <system>
Aug 14 12:41:55 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:41:55 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:41:55 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:41:55 user nova-compute[73012]:       <entry name="serial">41101a51-ac3f-43a8-b4c3-94d17cb53fea</entry>
Aug 14 12:41:55 user nova-compute[73012]:       <entry name="uuid">41101a51-ac3f-43a8-b4c3-94d17cb53fea</entry>
Aug 14 12:41:55 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:41:55 user nova-compute[73012]:     </system>
Aug 14 12:41:55 user nova-compute[73012]:   </sysinfo>
Aug 14 12:41:55 user nova-compute[73012]:   <os>
Aug 14 12:41:55 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:41:55 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:41:55 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:41:55 user nova-compute[73012]:   </os>
Aug 14 12:41:55 user nova-compute[73012]:   <features>
Aug 14 12:41:55 user nova-compute[73012]:     <acpi/>
Aug 14 12:41:55 user nova-compute[73012]:     <apic/>
Aug 14 12:41:55 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:41:55 user nova-compute[73012]:   </features>
Aug 14 12:41:55 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:41:55 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:41:55 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:41:55 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:41:55 user nova-compute[73012]:   </clock>
Aug 14 12:41:55 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:41:55 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:41:55 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:41:55 user nova-compute[73012]:   </cpu>
Aug 14 12:41:55 user nova-compute[73012]:   <devices>
Aug 14 12:41:55 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:41:55 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:41:55 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk"/>
Aug 14 12:41:55 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:41:55 user nova-compute[73012]:     </disk>
Aug 14 12:41:55 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:41:55 user nova-compute[73012]:       <mac address="fa:16:3e:36:aa:dc"/>
Aug 14 12:41:55 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:41:55 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:41:55 user nova-compute[73012]:       <target dev="tap4bc1ef84-7c"/>
Aug 14 12:41:55 user nova-compute[73012]:     </interface>
Aug 14 12:41:55 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:41:55 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/console.log" append="off"/>
Aug 14 12:41:55 user nova-compute[73012]:     </serial>
Aug 14 12:41:55 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:41:55 user nova-compute[73012]:     <video>
Aug 14 12:41:55 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:41:55 user nova-compute[73012]:     </video>
Aug 14 12:41:55 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:41:55 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:41:55 user nova-compute[73012]:     </rng>
Aug 14 12:41:55 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:41:55 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:41:55 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:41:55 user nova-compute[73012]:     </memballoon>
Aug 14 12:41:55 user nova-compute[73012]:   </devices>
Aug 14 12:41:55 user nova-compute[73012]: </domain>
Aug 14 12:41:55 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2066996628',display_name='tempest-VolumesSnapshotTestJSON-instance-2066996628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2066996628',id=49,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPrCIg8n75g8gCQ+iQMNj/R37QmrXcqS4eqw2C2wkfukLaK4+Q3HS3OD5xZAMtyFbczkZR0icyOHKiMIiXC8hktGlcO+TaCO2bw8rk3N92tv3ZvljQqC0YnlwBUFvNgeA==',key_name='tempest-keypair-164325201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ab505f398334cd695ac16793ab4b7c9',ramdisk_id='',reservation_id='r-twangh1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1686077578',owner_user_name='tempest-VolumesSnapshotTestJSON-1686077578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feaad28b32a4769acbbc87598f0da59',uuid=41101a51-ac3f-43a8-b4c3-94d17cb53fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converting VIF {"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:aa:dc,bridge_name='br-int',has_traffic_filtering=True,id=4bc1ef84-7c83-4ed6-8855-8f41814c441f,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc1ef84-7c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG os_vif [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:aa:dc,bridge_name='br-int',has_traffic_filtering=True,id=4bc1ef84-7c83-4ed6-8855-8f41814c441f,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc1ef84-7c') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bc1ef84-7c, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bc1ef84-7c, col_values=(('external_ids', {'iface-id': '4bc1ef84-7c83-4ed6-8855-8f41814c441f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:aa:dc', 'vm-uuid': '41101a51-ac3f-43a8-b4c3-94d17cb53fea'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:55 user nova-compute[73012]: INFO os_vif [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:aa:dc,bridge_name='br-int',has_traffic_filtering=True,id=4bc1ef84-7c83-4ed6-8855-8f41814c441f,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc1ef84-7c')
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No VIF found with MAC fa:16:3e:36:aa:dc, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-fbb6bea5-2ea4-4190-bdf0-43c62a9c0627 req-4bc09f27-5ea0-49ce-be09-6df4c21890f1 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updated VIF entry in instance network info cache for port 4bc1ef84-7c83-4ed6-8855-8f41814c441f. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG nova.network.neutron [req-fbb6bea5-2ea4-4190-bdf0-43c62a9c0627 req-4bc09f27-5ea0-49ce-be09-6df4c21890f1 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updating instance_info_cache with network_info: [{"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:41:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-fbb6bea5-2ea4-4190-bdf0-43c62a9c0627 req-4bc09f27-5ea0-49ce-be09-6df4c21890f1 service nova] Releasing lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:41:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-c3755393-e15a-49f3-aafd-5f5d56713521 req-3ec3bb63-6b12-4302-92fe-597893686253 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received event network-vif-plugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c3755393-e15a-49f3-aafd-5f5d56713521 req-3ec3bb63-6b12-4302-92fe-597893686253 service nova] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c3755393-e15a-49f3-aafd-5f5d56713521 req-3ec3bb63-6b12-4302-92fe-597893686253 service nova] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:56 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c3755393-e15a-49f3-aafd-5f5d56713521 req-3ec3bb63-6b12-4302-92fe-597893686253 service nova] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:56 user nova-compute[73012]: DEBUG nova.compute.manager [req-c3755393-e15a-49f3-aafd-5f5d56713521 req-3ec3bb63-6b12-4302-92fe-597893686253 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] No waiting events found dispatching network-vif-plugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:41:56 user nova-compute[73012]: WARNING nova.compute.manager [req-c3755393-e15a-49f3-aafd-5f5d56713521 req-3ec3bb63-6b12-4302-92fe-597893686253 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received unexpected event network-vif-plugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f for instance with vm_state building and task_state spawning.
Aug 14 12:41:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-3fa41fbd-591d-45c0-aaf3-5536c1a32c7d req-28fc062e-4a4a-44e2-b7bb-46b966c66ce3 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received event network-vif-plugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3fa41fbd-591d-45c0-aaf3-5536c1a32c7d req-28fc062e-4a4a-44e2-b7bb-46b966c66ce3 service nova] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3fa41fbd-591d-45c0-aaf3-5536c1a32c7d req-28fc062e-4a4a-44e2-b7bb-46b966c66ce3 service nova] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-3fa41fbd-591d-45c0-aaf3-5536c1a32c7d req-28fc062e-4a4a-44e2-b7bb-46b966c66ce3 service nova] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-3fa41fbd-591d-45c0-aaf3-5536c1a32c7d req-28fc062e-4a4a-44e2-b7bb-46b966c66ce3 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] No waiting events found dispatching network-vif-plugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:41:58 user nova-compute[73012]: WARNING nova.compute.manager [req-3fa41fbd-591d-45c0-aaf3-5536c1a32c7d req-28fc062e-4a4a-44e2-b7bb-46b966c66ce3 service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received unexpected event network-vif-plugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f for instance with vm_state building and task_state spawning.
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:41:58 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016918.996763, 41101a51-ac3f-43a8-b4c3-94d17cb53fea => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:41:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] VM Resumed (Lifecycle Event)
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:41:59 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Instance spawned successfully.
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:41:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692016919.0007174, 41101a51-ac3f-43a8-b4c3-94d17cb53fea => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:41:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] VM Started (Lifecycle Event)
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:41:59 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:41:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:41:59 user nova-compute[73012]: INFO nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:41:59 user nova-compute[73012]: INFO nova.compute.manager [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Took 7.04 seconds to build instance.
Aug 14 12:41:59 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:41:59 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.408111572265625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-1ec7e97b-1de9-4368-bbd1-58fa7a0ab6b1 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.136s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 41101a51-ac3f-43a8-b4c3-94d17cb53fea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:41:59 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:42:00 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:42:00 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:42:00 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:42:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:42:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:42:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:42:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:42:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:05 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:42:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:42:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:42:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:24 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:42:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:33 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:42:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:42:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:42:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:42:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:42:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:42:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:42:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:42:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:42:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:42:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:42:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:59 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:42:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:42:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:42:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:42:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:42:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:42:59 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updating instance_info_cache with network_info: [{"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:00 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:01 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:43:01 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:43:01 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=25.36856460571289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 41101a51-ac3f-43a8-b4c3-94d17cb53fea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:43:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:43:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:43:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:43:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:43:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Triggering sync for uuid 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 12:43:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:43:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:43:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:43:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:43:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:43:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:43:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:43:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:43:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:43:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:43:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:43:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:43:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:43:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:43:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:43:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:43:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-5aed0732-5541-42d4-8192-2c9dba181fa3 req-ecfd5fcc-4907-47a1-b4de-caf5ba4a8c7a service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received event network-changed-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG nova.compute.manager [req-5aed0732-5541-42d4-8192-2c9dba181fa3 req-ecfd5fcc-4907-47a1-b4de-caf5ba4a8c7a service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Refreshing instance network info cache due to event network-changed-4bc1ef84-7c83-4ed6-8855-8f41814c441f. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5aed0732-5541-42d4-8192-2c9dba181fa3 req-ecfd5fcc-4907-47a1-b4de-caf5ba4a8c7a service nova] Acquiring lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5aed0732-5541-42d4-8192-2c9dba181fa3 req-ecfd5fcc-4907-47a1-b4de-caf5ba4a8c7a service nova] Acquired lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-5aed0732-5541-42d4-8192-2c9dba181fa3 req-ecfd5fcc-4907-47a1-b4de-caf5ba4a8c7a service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Refreshing network info cache for port 4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'flavor' on Instance uuid 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:43:44 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Ignoring supplied device name: /dev/vdb
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:43:44 user nova-compute[73012]: INFO nova.compute.manager [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Attaching volume 1b208991-0f6d-4686-974a-a833db12942b to /dev/vdb
Aug 14 12:43:44 user nova-compute[73012]: DEBUG os_brick.utils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[70adea93-b911-4f32-ade7-e58b59d20547]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[672c9b89-eb41-4421-ab2f-bd626671eef8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c84391-58f1-42db-a2f4-fe5c67ddb0d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a1e6e1-ff24-4281-ad89-99e9bfefd719]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-5aed0732-5541-42d4-8192-2c9dba181fa3 req-ecfd5fcc-4907-47a1-b4de-caf5ba4a8c7a service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updated VIF entry in instance network info cache for port 4bc1ef84-7c83-4ed6-8855-8f41814c441f. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG nova.network.neutron [req-5aed0732-5541-42d4-8192-2c9dba181fa3 req-ecfd5fcc-4907-47a1-b4de-caf5ba4a8c7a service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updating instance_info_cache with network_info: [{"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:43:44 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ba9b8e-4079-4d71-bb2b-cb41f6a31cbd]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG os_brick.utils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updating existing volume attachment record: d401fe6b-0439-4ab0-b812-e6712f7a1840 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:43:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5aed0732-5541-42d4-8192-2c9dba181fa3 req-ecfd5fcc-4907-47a1-b4de-caf5ba4a8c7a service nova] Releasing lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:43:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:43:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkvupTcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:43:53 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:43:53 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:43:53 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9da499-b308-4b4b-83b2-fb550b8ab1ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:43:53 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a35da-f71d-45b9-9fd4-e9c354a380bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b] added
Aug 14 12:43:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec47ff5-79d5-47e7-9855-5d7ce8e47c7f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e688fbc5-10ec-4848-a973-9771ebd996bd]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkvupTcd {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LkvupTcd" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[207b6ee7-c5fc-4d39-850e-47409aa86947]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LkvupTcd'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7827783e-d073-4425-b548-6a17e8157444]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e54df6a-bb30-4c10-9381-ca39575bbae8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1ff554-ff6a-491a-9c54-4c233b114411 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1ff554-ff6a-491a-9c54-4c233b114411 (non-flash)
Aug 14 12:43:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1ff554-ff6a-491a-9c54-4c233b114411 (non-flash)
Aug 14 12:43:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d4c3db-c1e0-4c27-a365-d846c4c91c78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b, portal: 172.16.0.220,3260]
Aug 14 12:43:53 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b, portal: 172.16.0.220,3260] successful.
Aug 14 12:43:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a691a68b-650d-4687-9cf5-5e7c3de50e1f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c192219b-f29e-456c-a749-ec4e4b41a4dc]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1ff554-ff6a-491a-9c54-4c233b114411 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1ff554-ff6a-491a-9c54-4c233b114411 (non-flash)
Aug 14 12:43:53 user nova-compute[73012]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b (non-flash)
Aug 14 12:43:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd1ff554-ff6a-491a-9c54-4c233b114411 (non-flash)
Aug 14 12:43:53 user nova-compute[73012]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b (non-flash)
Aug 14 12:43:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b61ed62-dd44-4d1f-8d28-b41875bad648]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:43:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkvupTcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:43:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:43:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26662393530316233', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:43:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662393530316233', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:43:54 user nova-compute[73012]: DEBUG nova.objects.instance [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'flavor' on Instance uuid 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:43:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:43:54 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:43:54 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:43:54 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:43:54 user nova-compute[73012]:   <serial>1b208991-0f6d-4686-974a-a833db12942b</serial>
Aug 14 12:43:54 user nova-compute[73012]: </disk>
Aug 14 12:43:54 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:43:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:43:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:43:55 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] No VIF found with MAC fa:16:3e:36:aa:dc, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:43:55 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b62590be-fbe3-4ee9-9aac-35efd2681515 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.613s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:43:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:43:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:43:59 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:44:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updating instance_info_cache with network_info: [{"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-41101a51-ac3f-43a8-b4c3-94d17cb53fea" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:44:02 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:44:02 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:44:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=25.36569595336914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 41101a51-ac3f-43a8-b4c3-94d17cb53fea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:04 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:44:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:44:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:27 user nova-compute[73012]: INFO nova.compute.manager [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Detaching volume 1b208991-0f6d-4686-974a-a833db12942b
Aug 14 12:44:27 user nova-compute[73012]: INFO nova.virt.block_device [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Attempting to driver detach volume 1b208991-0f6d-4686-974a-a833db12942b from mountpoint /dev/vdb
Aug 14 12:44:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Attempting to detach device vdb from instance 41101a51-ac3f-43a8-b4c3-94d17cb53fea from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:44:27 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:44:27 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:44:27 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:44:27 user nova-compute[73012]:   <serial>1b208991-0f6d-4686-974a-a833db12942b</serial>
Aug 14 12:44:27 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:44:27 user nova-compute[73012]: </disk>
Aug 14 12:44:27 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:44:27 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Successfully detached device vdb from instance 41101a51-ac3f-43a8-b4c3-94d17cb53fea from the persistent domain config.
Aug 14 12:44:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 41101a51-ac3f-43a8-b4c3-94d17cb53fea from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:44:27 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:44:27 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:44:27 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:44:27 user nova-compute[73012]:   <serial>1b208991-0f6d-4686-974a-a833db12942b</serial>
Aug 14 12:44:27 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:44:27 user nova-compute[73012]: </disk>
Aug 14 12:44:27 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692017067.8771281, 41101a51-ac3f-43a8-b4c3-94d17cb53fea => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:44:27 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Successfully detached device vdb from instance 41101a51-ac3f-43a8-b4c3-94d17cb53fea from the live domain config.
Aug 14 12:44:27 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkvupTcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:44:27 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:44:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af21f0b-8cd3-4def-98dc-0a43de95dcd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f936a8b-02fe-48a5-acfa-e4d4ca7b730f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b (non-flash)
Aug 14 12:44:27 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b (non-flash)
Aug 14 12:44:27 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aacf02e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aea4a5-09af-40ca-84c4-88db87e27345]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efa093e-47e2-45d3-8c69-ddf2fd0edb03]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:44:27 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5263cd39-8471-482e-a502-cd675cb2b19a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f94bcb-1680-41d8-a63e-dbef4d66ec90]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1717871c-c283-4616-910a-9602b8d2c46b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d400f2f-dc40-44ba-8448-be93ec70e794]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b, portal: 172.16.0.220,3260]
Aug 14 12:44:28 user nova-compute[73012]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b, portal: 172.16.0.220,3260] successful.
Aug 14 12:44:28 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c2ac79-8d17-4c52-8ac1-43613113ffad]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] <== disconnect_volume: return (284ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:44:28 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.objects.instance [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'flavor' on Instance uuid 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-aec418ec-229d-4a1b-b2d1-62e416046646 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.749s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.629s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:29 user nova-compute[73012]: INFO nova.compute.manager [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Terminating instance
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-429e9280-0b47-4e3e-9146-7bbc0b1674eb req-362a9e0c-39c7-46a0-ba01-09fdeff7bbfb service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received event network-vif-unplugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-429e9280-0b47-4e3e-9146-7bbc0b1674eb req-362a9e0c-39c7-46a0-ba01-09fdeff7bbfb service nova] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-429e9280-0b47-4e3e-9146-7bbc0b1674eb req-362a9e0c-39c7-46a0-ba01-09fdeff7bbfb service nova] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-429e9280-0b47-4e3e-9146-7bbc0b1674eb req-362a9e0c-39c7-46a0-ba01-09fdeff7bbfb service nova] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-429e9280-0b47-4e3e-9146-7bbc0b1674eb req-362a9e0c-39c7-46a0-ba01-09fdeff7bbfb service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] No waiting events found dispatching network-vif-unplugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.compute.manager [req-429e9280-0b47-4e3e-9146-7bbc0b1674eb req-362a9e0c-39c7-46a0-ba01-09fdeff7bbfb service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received event network-vif-unplugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:29 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Instance destroyed successfully.
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.objects.instance [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lazy-loading 'resources' on Instance uuid 41101a51-ac3f-43a8-b4c3-94d17cb53fea {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2066996628',display_name='tempest-VolumesSnapshotTestJSON-instance-2066996628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2066996628',id=49,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPrCIg8n75g8gCQ+iQMNj/R37QmrXcqS4eqw2C2wkfukLaK4+Q3HS3OD5xZAMtyFbczkZR0icyOHKiMIiXC8hktGlcO+TaCO2bw8rk3N92tv3ZvljQqC0YnlwBUFvNgeA==',key_name='tempest-keypair-164325201',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:41:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ab505f398334cd695ac16793ab4b7c9',ramdisk_id='',reservation_id='r-twangh1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1686077578',owner_user_name='tempest-VolumesSnapshotTestJSON-1686077578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7feaad28b32a4769acbbc87598f0da59',uuid=41101a51-ac3f-43a8-b4c3-94d17cb53fea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converting VIF {"id": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "address": "fa:16:3e:36:aa:dc", "network": {"id": "b2729d5d-0212-4804-8ff1-a7ee19612795", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-532088128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ab505f398334cd695ac16793ab4b7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc1ef84-7c", "ovs_interfaceid": "4bc1ef84-7c83-4ed6-8855-8f41814c441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:aa:dc,bridge_name='br-int',has_traffic_filtering=True,id=4bc1ef84-7c83-4ed6-8855-8f41814c441f,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc1ef84-7c') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_vif [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:aa:dc,bridge_name='br-int',has_traffic_filtering=True,id=4bc1ef84-7c83-4ed6-8855-8f41814c441f,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc1ef84-7c') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bc1ef84-7c, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:44:29 user nova-compute[73012]: INFO os_vif [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:aa:dc,bridge_name='br-int',has_traffic_filtering=True,id=4bc1ef84-7c83-4ed6-8855-8f41814c441f,network=Network(b2729d5d-0212-4804-8ff1-a7ee19612795),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc1ef84-7c')
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LkvupTcd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:44:29 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b208991-0f6d-4686-974a-a833db12942b', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb439182-f548-41c9-aeb7-f1b1d40ef86f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:29 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 14 12:44:29 user nova-compute[73012]: 
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21cfc3d-d74a-4599-ad86-ba4182d3be11]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:44:29 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:44:29 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:44:29 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:44:29 user nova-compute[73012]: 
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aace943a0>, {}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Disconnecting from: [] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] <== disconnect_volume: return (46ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:44:29 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:44:29 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Deleting instance files /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea_del
Aug 14 12:44:29 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Deletion of /opt/stack/data/nova/instances/41101a51-ac3f-43a8-b4c3-94d17cb53fea_del complete
Aug 14 12:44:30 user nova-compute[73012]: INFO nova.compute.manager [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 12:44:30 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:44:30 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:44:30 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:44:30 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:44:30 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Took 0.97 seconds to deallocate network for instance.
Aug 14 12:44:31 user nova-compute[73012]: WARNING nova.volume.cinder [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Attachment d401fe6b-0439-4ab0-b812-e6712f7a1840 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d401fe6b-0439-4ab0-b812-e6712f7a1840. (HTTP 404) (Request-ID: req-1578bd02-879f-4b5e-a1cc-749142f12fe8)
Aug 14 12:44:31 user nova-compute[73012]: INFO nova.compute.manager [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Took 0.03 seconds to detach 1 volumes for instance.
Aug 14 12:44:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:31 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:44:31 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:44:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:31 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Deleted allocations for instance 41101a51-ac3f-43a8-b4c3-94d17cb53fea
Aug 14 12:44:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-328c871c-9304-4590-a1c9-2cd8a77f3f63 tempest-VolumesSnapshotTestJSON-1686077578 tempest-VolumesSnapshotTestJSON-1686077578-project-member] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.265s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-c9cef77b-e63a-4d4f-8495-61bafad497f6 req-6af922e3-169e-4f90-aa31-d68aa9dec8ab service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received event network-vif-plugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:44:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c9cef77b-e63a-4d4f-8495-61bafad497f6 req-6af922e3-169e-4f90-aa31-d68aa9dec8ab service nova] Acquiring lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c9cef77b-e63a-4d4f-8495-61bafad497f6 req-6af922e3-169e-4f90-aa31-d68aa9dec8ab service nova] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c9cef77b-e63a-4d4f-8495-61bafad497f6 req-6af922e3-169e-4f90-aa31-d68aa9dec8ab service nova] Lock "41101a51-ac3f-43a8-b4c3-94d17cb53fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-c9cef77b-e63a-4d4f-8495-61bafad497f6 req-6af922e3-169e-4f90-aa31-d68aa9dec8ab service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] No waiting events found dispatching network-vif-plugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:44:31 user nova-compute[73012]: WARNING nova.compute.manager [req-c9cef77b-e63a-4d4f-8495-61bafad497f6 req-6af922e3-169e-4f90-aa31-d68aa9dec8ab service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received unexpected event network-vif-plugged-4bc1ef84-7c83-4ed6-8855-8f41814c441f for instance with vm_state deleted and task_state None.
Aug 14 12:44:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-c9cef77b-e63a-4d4f-8495-61bafad497f6 req-6af922e3-169e-4f90-aa31-d68aa9dec8ab service nova] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Received event network-vif-deleted-4bc1ef84-7c83-4ed6-8855-8f41814c441f {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:44:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:44:43 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:44 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692017069.8524783, 41101a51-ac3f-43a8-b4c3-94d17cb53fea => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:44:44 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] VM Stopped (Lifecycle Event)
Aug 14 12:44:44 user nova-compute[73012]: DEBUG nova.compute.manager [None req-31952b82-4ef5-4473-a89a-763894968d54 None None] [instance: 41101a51-ac3f-43a8-b4c3-94d17cb53fea] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:44:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:53 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:44:57 user nova-compute[73012]: INFO nova.compute.claims [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Claim successful on node user
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.network.neutron [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:44:57 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.policy [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e94d26c7cf044b3a33424a6bad7c3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b635614658433dba3cfd95bbeb2212', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:44:57 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Creating image(s)
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "/opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "/opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.170s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.171s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk 1073741824" returned: 0 in 0.053s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG nova.network.neutron [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Successfully created port: 0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Cannot resize image /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG nova.objects.instance [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'migration_context' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Ensure instance console log exists: /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:44:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Successfully updated port: 0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquired lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-de1a49d1-2c4d-4220-9acd-709d4dbe1366 req-855ed35f-2196-4908-b0ca-91f99fc79d76 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-changed-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.compute.manager [req-de1a49d1-2c4d-4220-9acd-709d4dbe1366 req-855ed35f-2196-4908-b0ca-91f99fc79d76 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Refreshing instance network info cache due to event network-changed-0eab5865-c52c-45bc-a6dd-9c80631117ac. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-de1a49d1-2c4d-4220-9acd-709d4dbe1366 req-855ed35f-2196-4908-b0ca-91f99fc79d76 service nova] Acquiring lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.neutron [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Releasing lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Instance network_info: |[{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-de1a49d1-2c4d-4220-9acd-709d4dbe1366 req-855ed35f-2196-4908-b0ca-91f99fc79d76 service nova] Acquired lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-de1a49d1-2c4d-4220-9acd-709d4dbe1366 req-855ed35f-2196-4908-b0ca-91f99fc79d76 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Refreshing network info cache for port 0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Start _get_guest_xml network_info=[{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:44:59 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:44:59 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1568061317',display_name='tempest-TestStampPattern-server-1568061317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1568061317',id=50,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyY0+OY/CO/IIvMQ5wsjRAn/w+1oNa4ySH/gHvhGG3ROhkdKEAFgypHmb7QNsy/eRvRhukohjwyhL3nWH2e9muZBjpJv5rJjMoL4gDXL3THZUUwL60K1ST/tWlaiDNE7Q==',key_name='tempest-TestStampPattern-1351324735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5b635614658433dba3cfd95bbeb2212',ramdisk_id='',reservation_id='r-mdida70b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1040723128',owner_user_name='tempest-TestStampPattern-1040723128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:44:58Z,user_data=None,user_id='8e94d26c7cf044b3a33424a6bad7c3ac',uuid=9f636897-a882-4c8b-8df7-a068a7ec2717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converting VIF {"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=0eab5865-c52c-45bc-a6dd-9c80631117ac,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eab5865-c5') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.objects.instance [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:44:59 user nova-compute[73012]:   <uuid>9f636897-a882-4c8b-8df7-a068a7ec2717</uuid>
Aug 14 12:44:59 user nova-compute[73012]:   <name>instance-00000032</name>
Aug 14 12:44:59 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:44:59 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:44:59 user nova-compute[73012]:   <metadata>
Aug 14 12:44:59 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:44:59 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:44:59 user nova-compute[73012]:       <nova:name>tempest-TestStampPattern-server-1568061317</nova:name>
Aug 14 12:44:59 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:44:59</nova:creationTime>
Aug 14 12:44:59 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:44:59 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:44:59 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:44:59 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:44:59 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:44:59 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:44:59 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:44:59 user nova-compute[73012]:       <nova:owner>
Aug 14 12:44:59 user nova-compute[73012]:         <nova:user uuid="8e94d26c7cf044b3a33424a6bad7c3ac">tempest-TestStampPattern-1040723128-project-member</nova:user>
Aug 14 12:44:59 user nova-compute[73012]:         <nova:project uuid="b5b635614658433dba3cfd95bbeb2212">tempest-TestStampPattern-1040723128</nova:project>
Aug 14 12:44:59 user nova-compute[73012]:       </nova:owner>
Aug 14 12:44:59 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:44:59 user nova-compute[73012]:       <nova:ports>
Aug 14 12:44:59 user nova-compute[73012]:         <nova:port uuid="0eab5865-c52c-45bc-a6dd-9c80631117ac">
Aug 14 12:44:59 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 12:44:59 user nova-compute[73012]:         </nova:port>
Aug 14 12:44:59 user nova-compute[73012]:       </nova:ports>
Aug 14 12:44:59 user nova-compute[73012]:     </nova:instance>
Aug 14 12:44:59 user nova-compute[73012]:   </metadata>
Aug 14 12:44:59 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:44:59 user nova-compute[73012]:     <system>
Aug 14 12:44:59 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:44:59 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:44:59 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:44:59 user nova-compute[73012]:       <entry name="serial">9f636897-a882-4c8b-8df7-a068a7ec2717</entry>
Aug 14 12:44:59 user nova-compute[73012]:       <entry name="uuid">9f636897-a882-4c8b-8df7-a068a7ec2717</entry>
Aug 14 12:44:59 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:44:59 user nova-compute[73012]:     </system>
Aug 14 12:44:59 user nova-compute[73012]:   </sysinfo>
Aug 14 12:44:59 user nova-compute[73012]:   <os>
Aug 14 12:44:59 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:44:59 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:44:59 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:44:59 user nova-compute[73012]:   </os>
Aug 14 12:44:59 user nova-compute[73012]:   <features>
Aug 14 12:44:59 user nova-compute[73012]:     <acpi/>
Aug 14 12:44:59 user nova-compute[73012]:     <apic/>
Aug 14 12:44:59 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:44:59 user nova-compute[73012]:   </features>
Aug 14 12:44:59 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:44:59 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:44:59 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:44:59 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:44:59 user nova-compute[73012]:   </clock>
Aug 14 12:44:59 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:44:59 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:44:59 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:44:59 user nova-compute[73012]:   </cpu>
Aug 14 12:44:59 user nova-compute[73012]:   <devices>
Aug 14 12:44:59 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:44:59 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:44:59 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk"/>
Aug 14 12:44:59 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:44:59 user nova-compute[73012]:     </disk>
Aug 14 12:44:59 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:44:59 user nova-compute[73012]:       <mac address="fa:16:3e:88:b5:4e"/>
Aug 14 12:44:59 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:44:59 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:44:59 user nova-compute[73012]:       <target dev="tap0eab5865-c5"/>
Aug 14 12:44:59 user nova-compute[73012]:     </interface>
Aug 14 12:44:59 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:44:59 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/console.log" append="off"/>
Aug 14 12:44:59 user nova-compute[73012]:     </serial>
Aug 14 12:44:59 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:44:59 user nova-compute[73012]:     <video>
Aug 14 12:44:59 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:44:59 user nova-compute[73012]:     </video>
Aug 14 12:44:59 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:44:59 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:44:59 user nova-compute[73012]:     </rng>
Aug 14 12:44:59 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:44:59 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:44:59 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:44:59 user nova-compute[73012]:     </memballoon>
Aug 14 12:44:59 user nova-compute[73012]:   </devices>
Aug 14 12:44:59 user nova-compute[73012]: </domain>
Aug 14 12:44:59 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1568061317',display_name='tempest-TestStampPattern-server-1568061317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1568061317',id=50,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyY0+OY/CO/IIvMQ5wsjRAn/w+1oNa4ySH/gHvhGG3ROhkdKEAFgypHmb7QNsy/eRvRhukohjwyhL3nWH2e9muZBjpJv5rJjMoL4gDXL3THZUUwL60K1ST/tWlaiDNE7Q==',key_name='tempest-TestStampPattern-1351324735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5b635614658433dba3cfd95bbeb2212',ramdisk_id='',reservation_id='r-mdida70b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1040723128',owner_user_name='tempest-TestStampPattern-1040723128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:44:58Z,user_data=None,user_id='8e94d26c7cf044b3a33424a6bad7c3ac',uuid=9f636897-a882-4c8b-8df7-a068a7ec2717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converting VIF {"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=0eab5865-c52c-45bc-a6dd-9c80631117ac,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eab5865-c5') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG os_vif [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=0eab5865-c52c-45bc-a6dd-9c80631117ac,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eab5865-c5') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0eab5865-c5, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0eab5865-c5, col_values=(('external_ids', {'iface-id': '0eab5865-c52c-45bc-a6dd-9c80631117ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:b5:4e', 'vm-uuid': '9f636897-a882-4c8b-8df7-a068a7ec2717'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:44:59 user nova-compute[73012]: INFO os_vif [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=0eab5865-c52c-45bc-a6dd-9c80631117ac,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eab5865-c5')
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No VIF found with MAC fa:16:3e:88:b5:4e, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-de1a49d1-2c4d-4220-9acd-709d4dbe1366 req-855ed35f-2196-4908-b0ca-91f99fc79d76 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updated VIF entry in instance network info cache for port 0eab5865-c52c-45bc-a6dd-9c80631117ac. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG nova.network.neutron [req-de1a49d1-2c4d-4220-9acd-709d4dbe1366 req-855ed35f-2196-4908-b0ca-91f99fc79d76 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:44:59 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-de1a49d1-2c4d-4220-9acd-709d4dbe1366 req-855ed35f-2196-4908-b0ca-91f99fc79d76 service nova] Releasing lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:45:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-01055605-adeb-4334-9242-d19dda4e86ff req-1ea4e0c8-1d5b-4985-acc3-e84acaca643f service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-01055605-adeb-4334-9242-d19dda4e86ff req-1ea4e0c8-1d5b-4985-acc3-e84acaca643f service nova] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-01055605-adeb-4334-9242-d19dda4e86ff req-1ea4e0c8-1d5b-4985-acc3-e84acaca643f service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-01055605-adeb-4334-9242-d19dda4e86ff req-1ea4e0c8-1d5b-4985-acc3-e84acaca643f service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG nova.compute.manager [req-01055605-adeb-4334-9242-d19dda4e86ff req-1ea4e0c8-1d5b-4985-acc3-e84acaca643f service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] No waiting events found dispatching network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:45:01 user nova-compute[73012]: WARNING nova.compute.manager [req-01055605-adeb-4334-9242-d19dda4e86ff req-1ea4e0c8-1d5b-4985-acc3-e84acaca643f service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received unexpected event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac for instance with vm_state building and task_state spawning.
Aug 14 12:45:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:45:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:45:02 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:45:02 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8844MB free_disk=25.381572723388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9f636897-a882-4c8b-8df7-a068a7ec2717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692017102.947454, 9f636897-a882-4c8b-8df7-a068a7ec2717 => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:45:02 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] VM Resumed (Lifecycle Event)
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:45:02 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Instance spawned successfully.
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:45:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:45:03 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692017102.9478097, 9f636897-a882-4c8b-8df7-a068a7ec2717 => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:45:03 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] VM Started (Lifecycle Event)
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:45:03 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:45:03 user nova-compute[73012]: INFO nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:45:03 user nova-compute[73012]: INFO nova.compute.manager [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Took 6.06 seconds to build instance.
Aug 14 12:45:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-04288a3a-3098-4939-a2a2-92912047f86f tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.172s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-afe30611-016e-440f-869e-2cf123793df2 req-dbbc70a5-f746-40d9-baea-d224b5d22fe8 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-afe30611-016e-440f-869e-2cf123793df2 req-dbbc70a5-f746-40d9-baea-d224b5d22fe8 service nova] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-afe30611-016e-440f-869e-2cf123793df2 req-dbbc70a5-f746-40d9-baea-d224b5d22fe8 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-afe30611-016e-440f-869e-2cf123793df2 req-dbbc70a5-f746-40d9-baea-d224b5d22fe8 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.compute.manager [req-afe30611-016e-440f-869e-2cf123793df2 req-dbbc70a5-f746-40d9-baea-d224b5d22fe8 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] No waiting events found dispatching network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:45:03 user nova-compute[73012]: WARNING nova.compute.manager [req-afe30611-016e-440f-869e-2cf123793df2 req-dbbc70a5-f746-40d9-baea-d224b5d22fe8 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received unexpected event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac for instance with vm_state active and task_state None.
Aug 14 12:45:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:45:03 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:45:04 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:45:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:45:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:45:04 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:45:04 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:45:04 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:45:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:45:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:45:07 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:45:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:45:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:45:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:45:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:45:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:45:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:45:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:46:01 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:46:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:46:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:46:02 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:46:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:03 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:46:03 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:46:03 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=25.351856231689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9f636897-a882-4c8b-8df7-a068a7ec2717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:46:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:46:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:46:04 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:46:04 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:46:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:46:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:46:04 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:46:04 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:46:05 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:46:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:46:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:46:05 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:05 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:46:07 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:46:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:46:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:46:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:46:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:46:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:46:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-f80d993e-eb3d-4d1c-8621-9bbc46d96b95 req-28adab58-4ba2-401e-8b07-bed0fdab88a7 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-changed-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:46:49 user nova-compute[73012]: DEBUG nova.compute.manager [req-f80d993e-eb3d-4d1c-8621-9bbc46d96b95 req-28adab58-4ba2-401e-8b07-bed0fdab88a7 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Refreshing instance network info cache due to event network-changed-0eab5865-c52c-45bc-a6dd-9c80631117ac. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:46:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f80d993e-eb3d-4d1c-8621-9bbc46d96b95 req-28adab58-4ba2-401e-8b07-bed0fdab88a7 service nova] Acquiring lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:46:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f80d993e-eb3d-4d1c-8621-9bbc46d96b95 req-28adab58-4ba2-401e-8b07-bed0fdab88a7 service nova] Acquired lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:46:49 user nova-compute[73012]: DEBUG nova.network.neutron [req-f80d993e-eb3d-4d1c-8621-9bbc46d96b95 req-28adab58-4ba2-401e-8b07-bed0fdab88a7 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Refreshing network info cache for port 0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:46:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-f80d993e-eb3d-4d1c-8621-9bbc46d96b95 req-28adab58-4ba2-401e-8b07-bed0fdab88a7 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updated VIF entry in instance network info cache for port 0eab5865-c52c-45bc-a6dd-9c80631117ac. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG nova.network.neutron [req-f80d993e-eb3d-4d1c-8621-9bbc46d96b95 req-28adab58-4ba2-401e-8b07-bed0fdab88a7 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f80d993e-eb3d-4d1c-8621-9bbc46d96b95 req-28adab58-4ba2-401e-8b07-bed0fdab88a7 service nova] Releasing lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG nova.objects.instance [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'flavor' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:46:50 user nova-compute[73012]: INFO nova.compute.manager [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Attaching volume ece7ffaf-7dc8-45c1-8174-9009769dc7a4 to /dev/vdb
Aug 14 12:46:50 user nova-compute[73012]: DEBUG os_brick.utils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a946c35-e041-4d2e-9a01-197876112c2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6695ff-d185-4544-89ab-d7f74b849a00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e977ef-1f96-4c85-9c6b-b0871511c3d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb13a5d-b513-4069-a5b9-9c9a9dfad491]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:46:50 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:46:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd4e5cc-ecda-4151-971b-beb6ce8b737e]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG os_brick.utils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:46:50 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating existing volume attachment record: 70915bea-df9b-4813-a476-9a77ff9ce31c {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:46:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:53 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:58 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfFAYdUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:46:59 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:46:59 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:46:59 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e502b4-1ffe-4d67-b106-6340af6e1db1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:46:59 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a8dc9b-9f4b-4d75-892a-c4c68b0716ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4] added
Aug 14 12:46:59 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a86c77-73ee-43f3-a14d-0b0ec3c25209]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d80c5-639c-481a-ab7e-10e7d6cd9806]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfFAYdUI {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfFAYdUI" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e4004b-ebde-4288-80dc-cafc0003cf93]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfFAYdUI'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2204228-367b-4525-b575-cf89a0a27fba]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f615462c-9ec9-4ff2-ba2b-d1b2dfbb51e1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:46:59 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:46:59 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:46:59 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:46:59 user nova-compute[73012]: 
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff34c6f0-76a9-41e9-9758-dc61fd0670b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4, portal: 172.16.0.220,3260]
Aug 14 12:46:59 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4, portal: 172.16.0.220,3260] successful.
Aug 14 12:46:59 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f079fcf5-6030-4b23-8b97-2e1c9117d2ff]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[50578151-a94e-4bce-b1be-739386b92950]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 (non-flash)
Aug 14 12:46:59 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 (non-flash)
Aug 14 12:46:59 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3206b10e-c5a2-4f7f-9364-541f11a470b5]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:46:59 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfFAYdUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:47:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:47:00 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26433306563643434', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:47:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433306563643434', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:47:00 user nova-compute[73012]: DEBUG nova.objects.instance [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'flavor' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:47:00 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:47:00 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:47:00 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:47:00 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:47:00 user nova-compute[73012]:   <serial>ece7ffaf-7dc8-45c1-8174-9009769dc7a4</serial>
Aug 14 12:47:00 user nova-compute[73012]: </disk>
Aug 14 12:47:00 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:47:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:47:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:47:01 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No VIF found with MAC fa:16:3e:88:b5:4e, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:47:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-159e85a8-ad15-40d5-8ac7-84bc84933464 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.590s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:03 user nova-compute[73012]: INFO nova.compute.manager [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Detaching volume ece7ffaf-7dc8-45c1-8174-9009769dc7a4
Aug 14 12:47:03 user nova-compute[73012]: INFO nova.virt.block_device [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Attempting to driver detach volume ece7ffaf-7dc8-45c1-8174-9009769dc7a4 from mountpoint /dev/vdb
Aug 14 12:47:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Attempting to detach device vdb from instance 9f636897-a882-4c8b-8df7-a068a7ec2717 from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:47:03 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:47:03 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:47:03 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:47:03 user nova-compute[73012]:   <serial>ece7ffaf-7dc8-45c1-8174-9009769dc7a4</serial>
Aug 14 12:47:03 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:47:03 user nova-compute[73012]: </disk>
Aug 14 12:47:03 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:47:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Successfully detached device vdb from instance 9f636897-a882-4c8b-8df7-a068a7ec2717 from the persistent domain config.
Aug 14 12:47:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9f636897-a882-4c8b-8df7-a068a7ec2717 from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:47:03 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:47:03 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:47:03 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:47:03 user nova-compute[73012]:   <serial>ece7ffaf-7dc8-45c1-8174-9009769dc7a4</serial>
Aug 14 12:47:03 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:47:03 user nova-compute[73012]: </disk>
Aug 14 12:47:03 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692017223.9407935, 9f636897-a882-4c8b-8df7-a068a7ec2717 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:47:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Successfully detached device vdb from instance 9f636897-a882-4c8b-8df7-a068a7ec2717 from the live domain config.
Aug 14 12:47:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfFAYdUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:47:03 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:47:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d48dab-2d30-4b76-b7ad-b5f4d0bf6cbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd4632e-eaa1-4825-958b-f6cfa04ff204]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:47:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 (non-flash)
Aug 14 12:47:03 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 (non-flash)
Aug 14 12:47:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad013c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c91bf47-02d8-4ff5-8da4-7ef846b504ee]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd27210-1ccd-4a2c-8d38-85ff7a551b19]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b169f1ac-5f99-4234-a406-b986f53c3f15]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b382ad-0f18-4783-af67-af972128755e]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[960d3303-7a32-45a4-8164-300592420dc3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29adafc-ec5b-4b62-ad84-e219e9b2f659]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4, portal: 172.16.0.220,3260]
Aug 14 12:47:04 user nova-compute[73012]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4, portal: 172.16.0.220,3260] successful.
Aug 14 12:47:04 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ece7ffaf-7dc8-45c1-8174-9009769dc7a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d41e365-fc9c-4e12-8958-74596d824b47]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] <== disconnect_volume: return (319ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:04 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:47:04 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:47:04 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8758MB free_disk=25.349822998046875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9f636897-a882-4c8b-8df7-a068a7ec2717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:47:04 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG nova.objects.instance [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'flavor' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-761ea8d1-863d-4d4f-84c5-f0eef1342ee7 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.734s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:47:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:47:06 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:47:07 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:47:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:47:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:47:08 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:47:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:47:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:47:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:47:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:47:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:47:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:47:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:23 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:47:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:47:33 user nova-compute[73012]: INFO nova.compute.claims [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Claim successful on node user
Aug 14 12:47:33 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:47:33 user nova-compute[73012]: DEBUG nova.network.neutron [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:47:33 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:47:33 user nova-compute[73012]: DEBUG nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG nova.policy [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1175227d96cc4644ba81166382f1dfa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5606415b860e48bba4c25b1625cdc909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:47:34 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Creating image(s)
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "/opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "/opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk 1073741824" returned: 0 in 0.056s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG nova.network.neutron [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Successfully created port: a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Cannot resize image /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG nova.objects.instance [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lazy-loading 'migration_context' on Instance uuid eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Ensure instance console log exists: /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:34 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Successfully updated port: a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquired lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-59df7719-a0f4-4a45-a409-a385ceebe654 req-06904776-6d65-4a52-9de5-de6e428aa230 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received event network-changed-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.compute.manager [req-59df7719-a0f4-4a45-a409-a385ceebe654 req-06904776-6d65-4a52-9de5-de6e428aa230 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Refreshing instance network info cache due to event network-changed-a691822b-bcf6-4ec1-b783-69477153a5b4. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-59df7719-a0f4-4a45-a409-a385ceebe654 req-06904776-6d65-4a52-9de5-de6e428aa230 service nova] Acquiring lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.neutron [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updating instance_info_cache with network_info: [{"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Releasing lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Instance network_info: |[{"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-59df7719-a0f4-4a45-a409-a385ceebe654 req-06904776-6d65-4a52-9de5-de6e428aa230 service nova] Acquired lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.neutron [req-59df7719-a0f4-4a45-a409-a385ceebe654 req-06904776-6d65-4a52-9de5-de6e428aa230 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Refreshing network info cache for port a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Start _get_guest_xml network_info=[{"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:47:36 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:47:36 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-926817035',display_name='tempest-TestServerVolumeAttachmentScenario-server-926817035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-926817035',id=51,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzGWjwNRdo8VdEc1SvXcGiiwRQN71JYUCqlDKZBPRznR1FqoFhcjCaYdXBMpT5uMdEp2dOYIUf6YPyN+gJi6r/SYAeCD+DFHbJ8q/vnCgVqX7cwm/AaryG7r4gPEUB1SQ==',key_name='tempest-keypair-734511039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5606415b860e48bba4c25b1625cdc909',ramdisk_id='',reservation_id='r-7q78ace0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1213091456',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1213091456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1175227d96cc4644ba81166382f1dfa9',uuid=eb783a96-9cc0-4e35-9e91-9c536b9b8d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Converting VIF {"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:10:75,bridge_name='br-int',has_traffic_filtering=True,id=a691822b-bcf6-4ec1-b783-69477153a5b4,network=Network(e48d2405-aa41-4e3c-b631-10ad28c5dfe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa691822b-bc') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.objects.instance [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lazy-loading 'pci_devices' on Instance uuid eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:47:36 user nova-compute[73012]:   <uuid>eb783a96-9cc0-4e35-9e91-9c536b9b8d5d</uuid>
Aug 14 12:47:36 user nova-compute[73012]:   <name>instance-00000033</name>
Aug 14 12:47:36 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:47:36 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:47:36 user nova-compute[73012]:   <metadata>
Aug 14 12:47:36 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:47:36 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:47:36 user nova-compute[73012]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-926817035</nova:name>
Aug 14 12:47:36 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:47:36</nova:creationTime>
Aug 14 12:47:36 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:47:36 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:47:36 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:47:36 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:47:36 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:47:36 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:47:36 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:47:36 user nova-compute[73012]:       <nova:owner>
Aug 14 12:47:36 user nova-compute[73012]:         <nova:user uuid="1175227d96cc4644ba81166382f1dfa9">tempest-TestServerVolumeAttachmentScenario-1213091456-project-member</nova:user>
Aug 14 12:47:36 user nova-compute[73012]:         <nova:project uuid="5606415b860e48bba4c25b1625cdc909">tempest-TestServerVolumeAttachmentScenario-1213091456</nova:project>
Aug 14 12:47:36 user nova-compute[73012]:       </nova:owner>
Aug 14 12:47:36 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:47:36 user nova-compute[73012]:       <nova:ports>
Aug 14 12:47:36 user nova-compute[73012]:         <nova:port uuid="a691822b-bcf6-4ec1-b783-69477153a5b4">
Aug 14 12:47:36 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 12:47:36 user nova-compute[73012]:         </nova:port>
Aug 14 12:47:36 user nova-compute[73012]:       </nova:ports>
Aug 14 12:47:36 user nova-compute[73012]:     </nova:instance>
Aug 14 12:47:36 user nova-compute[73012]:   </metadata>
Aug 14 12:47:36 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:47:36 user nova-compute[73012]:     <system>
Aug 14 12:47:36 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:47:36 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:47:36 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:47:36 user nova-compute[73012]:       <entry name="serial">eb783a96-9cc0-4e35-9e91-9c536b9b8d5d</entry>
Aug 14 12:47:36 user nova-compute[73012]:       <entry name="uuid">eb783a96-9cc0-4e35-9e91-9c536b9b8d5d</entry>
Aug 14 12:47:36 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:47:36 user nova-compute[73012]:     </system>
Aug 14 12:47:36 user nova-compute[73012]:   </sysinfo>
Aug 14 12:47:36 user nova-compute[73012]:   <os>
Aug 14 12:47:36 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:47:36 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:47:36 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:47:36 user nova-compute[73012]:   </os>
Aug 14 12:47:36 user nova-compute[73012]:   <features>
Aug 14 12:47:36 user nova-compute[73012]:     <acpi/>
Aug 14 12:47:36 user nova-compute[73012]:     <apic/>
Aug 14 12:47:36 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:47:36 user nova-compute[73012]:   </features>
Aug 14 12:47:36 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:47:36 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:47:36 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:47:36 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:47:36 user nova-compute[73012]:   </clock>
Aug 14 12:47:36 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:47:36 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:47:36 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:47:36 user nova-compute[73012]:   </cpu>
Aug 14 12:47:36 user nova-compute[73012]:   <devices>
Aug 14 12:47:36 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:47:36 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:47:36 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk"/>
Aug 14 12:47:36 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:47:36 user nova-compute[73012]:     </disk>
Aug 14 12:47:36 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:47:36 user nova-compute[73012]:       <mac address="fa:16:3e:aa:10:75"/>
Aug 14 12:47:36 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:47:36 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:47:36 user nova-compute[73012]:       <target dev="tapa691822b-bc"/>
Aug 14 12:47:36 user nova-compute[73012]:     </interface>
Aug 14 12:47:36 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:47:36 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/console.log" append="off"/>
Aug 14 12:47:36 user nova-compute[73012]:     </serial>
Aug 14 12:47:36 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:47:36 user nova-compute[73012]:     <video>
Aug 14 12:47:36 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:47:36 user nova-compute[73012]:     </video>
Aug 14 12:47:36 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:47:36 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:47:36 user nova-compute[73012]:     </rng>
Aug 14 12:47:36 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:47:36 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:47:36 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:47:36 user nova-compute[73012]:     </memballoon>
Aug 14 12:47:36 user nova-compute[73012]:   </devices>
Aug 14 12:47:36 user nova-compute[73012]: </domain>
Aug 14 12:47:36 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-926817035',display_name='tempest-TestServerVolumeAttachmentScenario-server-926817035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-926817035',id=51,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzGWjwNRdo8VdEc1SvXcGiiwRQN71JYUCqlDKZBPRznR1FqoFhcjCaYdXBMpT5uMdEp2dOYIUf6YPyN+gJi6r/SYAeCD+DFHbJ8q/vnCgVqX7cwm/AaryG7r4gPEUB1SQ==',key_name='tempest-keypair-734511039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5606415b860e48bba4c25b1625cdc909',ramdisk_id='',reservation_id='r-7q78ace0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1213091456',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1213091456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1175227d96cc4644ba81166382f1dfa9',uuid=eb783a96-9cc0-4e35-9e91-9c536b9b8d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Converting VIF {"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:10:75,bridge_name='br-int',has_traffic_filtering=True,id=a691822b-bcf6-4ec1-b783-69477153a5b4,network=Network(e48d2405-aa41-4e3c-b631-10ad28c5dfe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa691822b-bc') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG os_vif [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:10:75,bridge_name='br-int',has_traffic_filtering=True,id=a691822b-bcf6-4ec1-b783-69477153a5b4,network=Network(e48d2405-aa41-4e3c-b631-10ad28c5dfe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa691822b-bc') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa691822b-bc, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa691822b-bc, col_values=(('external_ids', {'iface-id': 'a691822b-bcf6-4ec1-b783-69477153a5b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:10:75', 'vm-uuid': 'eb783a96-9cc0-4e35-9e91-9c536b9b8d5d'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:36 user nova-compute[73012]: INFO os_vif [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:10:75,bridge_name='br-int',has_traffic_filtering=True,id=a691822b-bcf6-4ec1-b783-69477153a5b4,network=Network(e48d2405-aa41-4e3c-b631-10ad28c5dfe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa691822b-bc')
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] No VIF found with MAC fa:16:3e:aa:10:75, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.neutron [req-59df7719-a0f4-4a45-a409-a385ceebe654 req-06904776-6d65-4a52-9de5-de6e428aa230 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updated VIF entry in instance network info cache for port a691822b-bcf6-4ec1-b783-69477153a5b4. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG nova.network.neutron [req-59df7719-a0f4-4a45-a409-a385ceebe654 req-06904776-6d65-4a52-9de5-de6e428aa230 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updating instance_info_cache with network_info: [{"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:47:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-59df7719-a0f4-4a45-a409-a385ceebe654 req-06904776-6d65-4a52-9de5-de6e428aa230 service nova] Releasing lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:47:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-970a233d-ed94-4c7f-bd7d-44bdbfd333cd req-28385773-3e08-4a52-a431-316453f0f115 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received event network-vif-plugged-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:47:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-970a233d-ed94-4c7f-bd7d-44bdbfd333cd req-28385773-3e08-4a52-a431-316453f0f115 service nova] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-970a233d-ed94-4c7f-bd7d-44bdbfd333cd req-28385773-3e08-4a52-a431-316453f0f115 service nova] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-970a233d-ed94-4c7f-bd7d-44bdbfd333cd req-28385773-3e08-4a52-a431-316453f0f115 service nova] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:38 user nova-compute[73012]: DEBUG nova.compute.manager [req-970a233d-ed94-4c7f-bd7d-44bdbfd333cd req-28385773-3e08-4a52-a431-316453f0f115 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] No waiting events found dispatching network-vif-plugged-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:47:38 user nova-compute[73012]: WARNING nova.compute.manager [req-970a233d-ed94-4c7f-bd7d-44bdbfd333cd req-28385773-3e08-4a52-a431-316453f0f115 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received unexpected event network-vif-plugged-a691822b-bcf6-4ec1-b783-69477153a5b4 for instance with vm_state building and task_state spawning.
Aug 14 12:47:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:38 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:39 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692017259.9834852, eb783a96-9cc0-4e35-9e91-9c536b9b8d5d => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:47:39 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] VM Resumed (Lifecycle Event)
Aug 14 12:47:39 user nova-compute[73012]: DEBUG nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:47:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:47:39 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Instance spawned successfully.
Aug 14 12:47:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:47:40 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692017259.9883778, eb783a96-9cc0-4e35-9e91-9c536b9b8d5d => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:47:40 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] VM Started (Lifecycle Event)
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:47:40 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:47:40 user nova-compute[73012]: INFO nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:47:40 user nova-compute[73012]: INFO nova.compute.manager [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Took 6.55 seconds to build instance.
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-df74d356-1a26-4a10-89f5-fd958d5bdc81 req-a6c8f182-8061-4ca3-8a04-259f0734cb23 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received event network-vif-plugged-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-df74d356-1a26-4a10-89f5-fd958d5bdc81 req-a6c8f182-8061-4ca3-8a04-259f0734cb23 service nova] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-df74d356-1a26-4a10-89f5-fd958d5bdc81 req-a6c8f182-8061-4ca3-8a04-259f0734cb23 service nova] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-df74d356-1a26-4a10-89f5-fd958d5bdc81 req-a6c8f182-8061-4ca3-8a04-259f0734cb23 service nova] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:40 user nova-compute[73012]: DEBUG nova.compute.manager [req-df74d356-1a26-4a10-89f5-fd958d5bdc81 req-a6c8f182-8061-4ca3-8a04-259f0734cb23 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] No waiting events found dispatching network-vif-plugged-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:47:40 user nova-compute[73012]: WARNING nova.compute.manager [req-df74d356-1a26-4a10-89f5-fd958d5bdc81 req-a6c8f182-8061-4ca3-8a04-259f0734cb23 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received unexpected event network-vif-plugged-a691822b-bcf6-4ec1-b783-69477153a5b4 for instance with vm_state active and task_state None.
Aug 14 12:47:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-78889c02-e0a6-405b-a967-9602f46616af tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.666s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:47:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:47:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:47:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:47:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:47:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:47:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:00 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:00 user nova-compute[73012]: DEBUG nova.compute.manager [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:48:00 user nova-compute[73012]: INFO nova.compute.manager [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] instance snapshotting
Aug 14 12:48:00 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Beginning live snapshot process
Aug 14 12:48:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json -f qcow2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json -f qcow2 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm7srpdbw/fc06dd7195f34c339a177daa4e6fe30f.delta 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:01 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm7srpdbw/fc06dd7195f34c339a177daa4e6fe30f.delta 1073741824" returned: 0 in 0.052s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:01 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 12:48:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:48:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:02 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] COPY block job progress, current cursor: 21299200 final cursor: 75563008 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:48:03 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73012) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 12:48:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 12:48:03 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:48:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm7srpdbw/fc06dd7195f34c339a177daa4e6fe30f.delta /opt/stack/data/nova/instances/snapshots/tmpm7srpdbw/fc06dd7195f34c339a177daa4e6fe30f {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:03 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:48:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm7srpdbw/fc06dd7195f34c339a177daa4e6fe30f.delta /opt/stack/data/nova/instances/snapshots/tmpm7srpdbw/fc06dd7195f34c339a177daa4e6fe30f" returned: 0 in 0.462s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:03 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Snapshot extracted, beginning image upload
Aug 14 12:48:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:05 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:48:05 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:48:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=25.272491455078125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9f636897-a882-4c8b-8df7-a068a7ec2717 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:48:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:06 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Snapshot image upload complete
Aug 14 12:48:06 user nova-compute[73012]: INFO nova.compute.manager [None req-60e95e88-3f36-4432-b05e-22c9d72ed572 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Took 5.69 seconds to snapshot the instance on the hypervisor.
Aug 14 12:48:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:48:08 user nova-compute[73012]: INFO nova.compute.claims [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Claim successful on node user
Aug 14 12:48:08 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:48:08 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:48:08 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:48:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:48:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:48:09 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Creating image(s)
Aug 14 12:48:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "/opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "/opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "7b8d8dcd79da4cf2fc99c32de5735b063d2fd249" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "7b8d8dcd79da4cf2fc99c32de5735b063d2fd249" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:09 user nova-compute[73012]: DEBUG nova.policy [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e94d26c7cf044b3a33424a6bad7c3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b635614658433dba3cfd95bbeb2212', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249.part --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249.part --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG nova.virt.images [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] f530bf3c-72be-4018-a9d0-373bf600fb33 was qcow2, converting to raw {{(pid=73012) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG nova.privsep.utils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73012) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249.part /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249.converted {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249.part /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249.converted" returned: 0 in 0.847s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249.converted --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Successfully created port: 038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "7b8d8dcd79da4cf2fc99c32de5735b063d2fd249" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.276s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249 --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "7b8d8dcd79da4cf2fc99c32de5735b063d2fd249" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "7b8d8dcd79da4cf2fc99c32de5735b063d2fd249" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249 --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249,backing_fmt=raw /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249,backing_fmt=raw /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk 1073741824" returned: 0 in 0.050s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "7b8d8dcd79da4cf2fc99c32de5735b063d2fd249" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8d8dcd79da4cf2fc99c32de5735b063d2fd249 --force-share --output=json" returned: 0 in 0.172s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG nova.objects.instance [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'migration_context' on Instance uuid d9d586e4-e2f6-4a19-9e51-a43964fccbfb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Ensure instance console log exists: /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Successfully updated port: 038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquired lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-16e47645-dad0-44af-8e9f-3efed71f134c req-c4ba7f0f-2e0c-4132-abb5-3f4df9c82d8e service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received event network-changed-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-16e47645-dad0-44af-8e9f-3efed71f134c req-c4ba7f0f-2e0c-4132-abb5-3f4df9c82d8e service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Refreshing instance network info cache due to event network-changed-038fb582-36e6-421c-9066-bbb636a3f5bf. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-16e47645-dad0-44af-8e9f-3efed71f134c req-c4ba7f0f-2e0c-4132-abb5-3f4df9c82d8e service nova] Acquiring lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Updating instance_info_cache with network_info: [{"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Releasing lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Instance network_info: |[{"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-16e47645-dad0-44af-8e9f-3efed71f134c req-c4ba7f0f-2e0c-4132-abb5-3f4df9c82d8e service nova] Acquired lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-16e47645-dad0-44af-8e9f-3efed71f134c req-c4ba7f0f-2e0c-4132-abb5-3f4df9c82d8e service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Refreshing network info cache for port 038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Start _get_guest_xml network_info=[{"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8fdea7ebb7864bcbfcc676fa6e6e1681',container_format='bare',created_at=2023-08-14T12:48:01Z,direct_url=<?>,disk_format='qcow2',id=f530bf3c-72be-4018-a9d0-373bf600fb33,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1759271964',owner='b5b635614658433dba3cfd95bbeb2212',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T12:48:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f530bf3c-72be-4018-a9d0-373bf600fb33'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:48:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:48:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8fdea7ebb7864bcbfcc676fa6e6e1681',container_format='bare',created_at=2023-08-14T12:48:01Z,direct_url=<?>,disk_format='qcow2',id=f530bf3c-72be-4018-a9d0-373bf600fb33,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1759271964',owner='b5b635614658433dba3cfd95bbeb2212',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T12:48:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1431617872',display_name='tempest-TestStampPattern-server-1431617872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1431617872',id=52,image_ref='f530bf3c-72be-4018-a9d0-373bf600fb33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyY0+OY/CO/IIvMQ5wsjRAn/w+1oNa4ySH/gHvhGG3ROhkdKEAFgypHmb7QNsy/eRvRhukohjwyhL3nWH2e9muZBjpJv5rJjMoL4gDXL3THZUUwL60K1ST/tWlaiDNE7Q==',key_name='tempest-TestStampPattern-1351324735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5b635614658433dba3cfd95bbeb2212',ramdisk_id='',reservation_id='r-v15ti7hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9f636897-a882-4c8b-8df7-a068a7ec2717',image_min_disk='1',image_min_ram='0',image_owner_id='b5b635614658433dba3cfd95bbeb2212',image_owner_project_name='tempest-TestStampPattern-1040723128',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1040723128-project-member',image_user_id='8e94d26c7cf044b3a33424a6bad7c3ac',network_allocated='True',owner_project_name='tempest-TestStampPattern-1040723128',owner_user_name='tempest-TestStampPattern-1040723128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:48:09Z,user_data=None,user_id='8e94d26c7cf044b3a33424a6bad7c3ac',uuid=d9d586e4-e2f6-4a19-9e51-a43964fccbfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converting VIF {"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:17:cf,bridge_name='br-int',has_traffic_filtering=True,id=038fb582-36e6-421c-9066-bbb636a3f5bf,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fb582-36') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'pci_devices' on Instance uuid d9d586e4-e2f6-4a19-9e51-a43964fccbfb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:48:12 user nova-compute[73012]:   <uuid>d9d586e4-e2f6-4a19-9e51-a43964fccbfb</uuid>
Aug 14 12:48:12 user nova-compute[73012]:   <name>instance-00000034</name>
Aug 14 12:48:12 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:48:12 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:48:12 user nova-compute[73012]:   <metadata>
Aug 14 12:48:12 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:48:12 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:48:12 user nova-compute[73012]:       <nova:name>tempest-TestStampPattern-server-1431617872</nova:name>
Aug 14 12:48:12 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:48:12</nova:creationTime>
Aug 14 12:48:12 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:48:12 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:48:12 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:48:12 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:48:12 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:48:12 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:48:12 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:48:12 user nova-compute[73012]:       <nova:owner>
Aug 14 12:48:12 user nova-compute[73012]:         <nova:user uuid="8e94d26c7cf044b3a33424a6bad7c3ac">tempest-TestStampPattern-1040723128-project-member</nova:user>
Aug 14 12:48:12 user nova-compute[73012]:         <nova:project uuid="b5b635614658433dba3cfd95bbeb2212">tempest-TestStampPattern-1040723128</nova:project>
Aug 14 12:48:12 user nova-compute[73012]:       </nova:owner>
Aug 14 12:48:12 user nova-compute[73012]:       <nova:root type="image" uuid="f530bf3c-72be-4018-a9d0-373bf600fb33"/>
Aug 14 12:48:12 user nova-compute[73012]:       <nova:ports>
Aug 14 12:48:12 user nova-compute[73012]:         <nova:port uuid="038fb582-36e6-421c-9066-bbb636a3f5bf">
Aug 14 12:48:12 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 12:48:12 user nova-compute[73012]:         </nova:port>
Aug 14 12:48:12 user nova-compute[73012]:       </nova:ports>
Aug 14 12:48:12 user nova-compute[73012]:     </nova:instance>
Aug 14 12:48:12 user nova-compute[73012]:   </metadata>
Aug 14 12:48:12 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:48:12 user nova-compute[73012]:     <system>
Aug 14 12:48:12 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:48:12 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:48:12 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:48:12 user nova-compute[73012]:       <entry name="serial">d9d586e4-e2f6-4a19-9e51-a43964fccbfb</entry>
Aug 14 12:48:12 user nova-compute[73012]:       <entry name="uuid">d9d586e4-e2f6-4a19-9e51-a43964fccbfb</entry>
Aug 14 12:48:12 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:48:12 user nova-compute[73012]:     </system>
Aug 14 12:48:12 user nova-compute[73012]:   </sysinfo>
Aug 14 12:48:12 user nova-compute[73012]:   <os>
Aug 14 12:48:12 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:48:12 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:48:12 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:48:12 user nova-compute[73012]:   </os>
Aug 14 12:48:12 user nova-compute[73012]:   <features>
Aug 14 12:48:12 user nova-compute[73012]:     <acpi/>
Aug 14 12:48:12 user nova-compute[73012]:     <apic/>
Aug 14 12:48:12 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:48:12 user nova-compute[73012]:   </features>
Aug 14 12:48:12 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:48:12 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:48:12 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:48:12 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:48:12 user nova-compute[73012]:   </clock>
Aug 14 12:48:12 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:48:12 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:48:12 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:48:12 user nova-compute[73012]:   </cpu>
Aug 14 12:48:12 user nova-compute[73012]:   <devices>
Aug 14 12:48:12 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:48:12 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:48:12 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk"/>
Aug 14 12:48:12 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:48:12 user nova-compute[73012]:     </disk>
Aug 14 12:48:12 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:48:12 user nova-compute[73012]:       <mac address="fa:16:3e:5f:17:cf"/>
Aug 14 12:48:12 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:48:12 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:48:12 user nova-compute[73012]:       <target dev="tap038fb582-36"/>
Aug 14 12:48:12 user nova-compute[73012]:     </interface>
Aug 14 12:48:12 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:48:12 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/console.log" append="off"/>
Aug 14 12:48:12 user nova-compute[73012]:     </serial>
Aug 14 12:48:12 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:48:12 user nova-compute[73012]:     <video>
Aug 14 12:48:12 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:48:12 user nova-compute[73012]:     </video>
Aug 14 12:48:12 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:48:12 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:48:12 user nova-compute[73012]:     </rng>
Aug 14 12:48:12 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:48:12 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:48:12 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:48:12 user nova-compute[73012]:     </memballoon>
Aug 14 12:48:12 user nova-compute[73012]:   </devices>
Aug 14 12:48:12 user nova-compute[73012]: </domain>
Aug 14 12:48:12 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1431617872',display_name='tempest-TestStampPattern-server-1431617872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1431617872',id=52,image_ref='f530bf3c-72be-4018-a9d0-373bf600fb33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyY0+OY/CO/IIvMQ5wsjRAn/w+1oNa4ySH/gHvhGG3ROhkdKEAFgypHmb7QNsy/eRvRhukohjwyhL3nWH2e9muZBjpJv5rJjMoL4gDXL3THZUUwL60K1ST/tWlaiDNE7Q==',key_name='tempest-TestStampPattern-1351324735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5b635614658433dba3cfd95bbeb2212',ramdisk_id='',reservation_id='r-v15ti7hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9f636897-a882-4c8b-8df7-a068a7ec2717',image_min_disk='1',image_min_ram='0',image_owner_id='b5b635614658433dba3cfd95bbeb2212',image_owner_project_name='tempest-TestStampPattern-1040723128',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1040723128-project-member',image_user_id='8e94d26c7cf044b3a33424a6bad7c3ac',network_allocated='True',owner_project_name='tempest-TestStampPattern-1040723128',owner_user_name='tempest-TestStampPattern-1040723128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:48:09Z,user_data=None,user_id='8e94d26c7cf044b3a33424a6bad7c3ac',uuid=d9d586e4-e2f6-4a19-9e51-a43964fccbfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converting VIF {"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:17:cf,bridge_name='br-int',has_traffic_filtering=True,id=038fb582-36e6-421c-9066-bbb636a3f5bf,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fb582-36') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG os_vif [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:17:cf,bridge_name='br-int',has_traffic_filtering=True,id=038fb582-36e6-421c-9066-bbb636a3f5bf,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fb582-36') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap038fb582-36, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap038fb582-36, col_values=(('external_ids', {'iface-id': '038fb582-36e6-421c-9066-bbb636a3f5bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:17:cf', 'vm-uuid': 'd9d586e4-e2f6-4a19-9e51-a43964fccbfb'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:12 user nova-compute[73012]: INFO os_vif [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:17:cf,bridge_name='br-int',has_traffic_filtering=True,id=038fb582-36e6-421c-9066-bbb636a3f5bf,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fb582-36')
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No VIF found with MAC fa:16:3e:5f:17:cf, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-16e47645-dad0-44af-8e9f-3efed71f134c req-c4ba7f0f-2e0c-4132-abb5-3f4df9c82d8e service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Updated VIF entry in instance network info cache for port 038fb582-36e6-421c-9066-bbb636a3f5bf. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG nova.network.neutron [req-16e47645-dad0-44af-8e9f-3efed71f134c req-c4ba7f0f-2e0c-4132-abb5-3f4df9c82d8e service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Updating instance_info_cache with network_info: [{"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:48:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-16e47645-dad0-44af-8e9f-3efed71f134c req-c4ba7f0f-2e0c-4132-abb5-3f4df9c82d8e service nova] Releasing lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:48:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-c02a8c7b-2757-4e10-b3fe-84073d3d36c6 req-be84bc8a-a5cb-4aed-b0a8-0efcbfde266a service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received event network-vif-plugged-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:48:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c02a8c7b-2757-4e10-b3fe-84073d3d36c6 req-be84bc8a-a5cb-4aed-b0a8-0efcbfde266a service nova] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c02a8c7b-2757-4e10-b3fe-84073d3d36c6 req-be84bc8a-a5cb-4aed-b0a8-0efcbfde266a service nova] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-c02a8c7b-2757-4e10-b3fe-84073d3d36c6 req-be84bc8a-a5cb-4aed-b0a8-0efcbfde266a service nova] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-c02a8c7b-2757-4e10-b3fe-84073d3d36c6 req-be84bc8a-a5cb-4aed-b0a8-0efcbfde266a service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] No waiting events found dispatching network-vif-plugged-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:48:14 user nova-compute[73012]: WARNING nova.compute.manager [req-c02a8c7b-2757-4e10-b3fe-84073d3d36c6 req-be84bc8a-a5cb-4aed-b0a8-0efcbfde266a service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received unexpected event network-vif-plugged-038fb582-36e6-421c-9066-bbb636a3f5bf for instance with vm_state building and task_state spawning.
Aug 14 12:48:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:15 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692017295.951641, d9d586e4-e2f6-4a19-9e51-a43964fccbfb => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:48:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] VM Resumed (Lifecycle Event)
Aug 14 12:48:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:48:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:48:15 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Instance spawned successfully.
Aug 14 12:48:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:48:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:48:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:48:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:48:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:48:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:48:16 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692017295.952746, d9d586e4-e2f6-4a19-9e51-a43964fccbfb => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:48:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] VM Started (Lifecycle Event)
Aug 14 12:48:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:48:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:48:16 user nova-compute[73012]: INFO nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 14 12:48:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:48:16 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:48:16 user nova-compute[73012]: INFO nova.compute.manager [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Took 7.58 seconds to build instance.
Aug 14 12:48:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-8f810521-f276-4adb-86a8-54ea2933a562 req-f64390da-7691-4b26-aec9-096e2be2b1ad service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received event network-vif-plugged-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:48:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8f810521-f276-4adb-86a8-54ea2933a562 req-f64390da-7691-4b26-aec9-096e2be2b1ad service nova] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:48:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8f810521-f276-4adb-86a8-54ea2933a562 req-f64390da-7691-4b26-aec9-096e2be2b1ad service nova] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:48:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-8f810521-f276-4adb-86a8-54ea2933a562 req-f64390da-7691-4b26-aec9-096e2be2b1ad service nova] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-8f810521-f276-4adb-86a8-54ea2933a562 req-f64390da-7691-4b26-aec9-096e2be2b1ad service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] No waiting events found dispatching network-vif-plugged-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:48:16 user nova-compute[73012]: WARNING nova.compute.manager [req-8f810521-f276-4adb-86a8-54ea2933a562 req-f64390da-7691-4b26-aec9-096e2be2b1ad service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received unexpected event network-vif-plugged-038fb582-36e6-421c-9066-bbb636a3f5bf for instance with vm_state active and task_state None.
Aug 14 12:48:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-bde4f150-296b-4eac-b0c2-b38b2f5337ab tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.684s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:48:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:48:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:48:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:00 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:49:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:49:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:49:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:49:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:49:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:49:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:49:03 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:49:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:05 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:49:05 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:49:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8555MB free_disk=25.164817810058594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9f636897-a882-4c8b-8df7-a068a7ec2717 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance d9d586e4-e2f6-4a19-9e51-a43964fccbfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:49:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:49:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:08 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:49:08 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:49:08 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:49:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:49:09 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:49:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:49:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:49:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:49:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updating instance_info_cache with network_info: [{"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:49:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:49:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:49:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:49:12 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:49:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:49:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:49:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:49:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:49:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:49:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:49:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-7ecc34ea-f875-46f8-b14c-15b598bdac20 req-2f1616d9-d782-4e00-99b8-017504c4f232 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received event network-changed-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:49:24 user nova-compute[73012]: DEBUG nova.compute.manager [req-7ecc34ea-f875-46f8-b14c-15b598bdac20 req-2f1616d9-d782-4e00-99b8-017504c4f232 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Refreshing instance network info cache due to event network-changed-a691822b-bcf6-4ec1-b783-69477153a5b4. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:49:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7ecc34ea-f875-46f8-b14c-15b598bdac20 req-2f1616d9-d782-4e00-99b8-017504c4f232 service nova] Acquiring lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:49:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7ecc34ea-f875-46f8-b14c-15b598bdac20 req-2f1616d9-d782-4e00-99b8-017504c4f232 service nova] Acquired lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:49:24 user nova-compute[73012]: DEBUG nova.network.neutron [req-7ecc34ea-f875-46f8-b14c-15b598bdac20 req-2f1616d9-d782-4e00-99b8-017504c4f232 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Refreshing network info cache for port a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-7ecc34ea-f875-46f8-b14c-15b598bdac20 req-2f1616d9-d782-4e00-99b8-017504c4f232 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updated VIF entry in instance network info cache for port a691822b-bcf6-4ec1-b783-69477153a5b4. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG nova.network.neutron [req-7ecc34ea-f875-46f8-b14c-15b598bdac20 req-2f1616d9-d782-4e00-99b8-017504c4f232 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updating instance_info_cache with network_info: [{"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7ecc34ea-f875-46f8-b14c-15b598bdac20 req-2f1616d9-d782-4e00-99b8-017504c4f232 service nova] Releasing lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lazy-loading 'flavor' on Instance uuid eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:49:25 user nova-compute[73012]: INFO nova.compute.manager [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Attaching volume 6c0dfe19-34a2-4234-93d2-987b2be410ca to /dev/vdb
Aug 14 12:49:25 user nova-compute[73012]: DEBUG os_brick.utils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a081e0-3201-4077-add9-8b65630ad688]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0da9af-272f-4748-931b-3b647441f17b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f161eb29-5ae9-444d-a021-645fd7a841b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f334a2-e008-4f62-b610-51f88e5f2a11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:49:25 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:49:25 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1103f6f-4495-40e8-b280-e340c3e1f9c0]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG os_brick.utils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:49:25 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updating existing volume attachment record: b78492b3-bae0-4cdb-b26a-fdb6f6cd2dfe {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:49:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wglpPIjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:49:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:49:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:49:34 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1861b0e3-4f02-430d-a9ae-8b56710d0951]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:49:34 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a316e77b-044b-4d3b-a784-d9ee321eacd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca] added
Aug 14 12:49:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[78553a05-0b22-4125-bbea-c3a99ffedc66]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd3457-1fed-4618-9c5f-4cb5d71e7d0a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wglpPIjc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wglpPIjc" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[124a0063-9ec9-4faf-b1e0-dd16fa7f9923]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wglpPIjc'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f196dd-4226-4a7b-90f5-e1f274617b31]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[05600c0d-e3d2-4ef3-9298-0987298cfaee]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:49:34 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:49:34 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:49:34 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:49:34 user nova-compute[73012]: 
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e7d1b-a1b6-40c4-b97e-c8aa40fad932]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca, portal: 172.16.0.220,3260]
Aug 14 12:49:34 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca, portal: 172.16.0.220,3260] successful.
Aug 14 12:49:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[627e7ced-198a-41eb-a8b8-f477c2c6b17c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb391b0a-209c-4493-bb26-89835a671962]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:49:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:49:34 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.091s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710715f-7f34-41d4-9aad-a73071561f24]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:49:34 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wglpPIjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:49:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:49:35 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23530336263616266', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:49:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530336263616266', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:49:35 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lazy-loading 'flavor' on Instance uuid eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:49:35 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:49:35 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:49:35 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:49:35 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:49:35 user nova-compute[73012]:   <serial>6c0dfe19-34a2-4234-93d2-987b2be410ca</serial>
Aug 14 12:49:35 user nova-compute[73012]: </disk>
Aug 14 12:49:35 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:49:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:49:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:49:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] No VIF found with MAC fa:16:3e:aa:10:75, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:49:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f3e38c87-a4e6-44e8-8db2-3430d2b46435 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.420s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:49:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:49:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:49:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lazy-loading 'flavor' on Instance uuid eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:49:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:49:39 user nova-compute[73012]: INFO nova.compute.manager [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Attaching volume f92558b5-e9c7-4da6-ad19-c57193e6ce54 to /dev/vdc
Aug 14 12:49:39 user nova-compute[73012]: DEBUG os_brick.utils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[611080d1-595c-404d-85dc-93d9701a9293]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e872e2-8943-4704-b34d-f57142ff8e9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3271000-8bb7-4bc2-be66-011dfe6a6375]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[510314ed-d734-4297-83fe-2c9e62caf7fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:49:39 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:49:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[965ac60e-d598-42ed-9c46-b651a351c591]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG os_brick.utils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] <== get_connector_properties: return (420ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:49:39 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updating existing volume attachment record: daa689a3-b38b-4353-ba80-0e23a6d1f95b {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:49:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tenJCHZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:49:47 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:49:47 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:49:47 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[29adb199-2a08-43ac-ab98-04744b7d56f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:49:47 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ba3ec4-e908-4f75-a4f8-20cfbd2cf9e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54] added
Aug 14 12:49:47 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f1a835-df61-4ea8-8893-400f88ff95f8]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a7e84b-c516-4c35-ab88-51958dbcb72b]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tenJCHZX {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tenJCHZX" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce8c0b8-2b3e-4620-b335-dad9036665c6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tenJCHZX'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[133abffd-1166-47b8-9872-f6c57aeac745]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd65dc22-1e44-4094-b9a9-a24a5487a8f2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:49:47 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:49:47 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cb5fa0-6b73-4861-8755-1c31470ebfa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54, portal: 172.16.0.220,3260]
Aug 14 12:49:47 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54, portal: 172.16.0.220,3260] successful.
Aug 14 12:49:47 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc40aa6d-5193-4295-988d-2b298d4415ca]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6271305-bfb3-4eb3-8ba6-ff0005056890]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:49:47 user nova-compute[73012]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 (non-flash)
Aug 14 12:49:47 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:49:47 user nova-compute[73012]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 (non-flash)
Aug 14 12:49:47 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52eee77-759b-4e57-ad85-ee6474f73d40]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:49:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tenJCHZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:49:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:49:48 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23837346564373566', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:49:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837346564373566', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:49:48 user nova-compute[73012]: DEBUG nova.objects.instance [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lazy-loading 'flavor' on Instance uuid eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:49:48 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:49:48 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:49:48 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:49:48 user nova-compute[73012]:   <target dev="vdc" bus="virtio"/>
Aug 14 12:49:48 user nova-compute[73012]:   <serial>f92558b5-e9c7-4da6-ad19-c57193e6ce54</serial>
Aug 14 12:49:48 user nova-compute[73012]: </disk>
Aug 14 12:49:48 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:49:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:49:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:49:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:49:49 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] No VIF found with MAC fa:16:3e:aa:10:75, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:49:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-2ab31055-6e87-41c0-b541-cab9552fe11d tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.307s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:49:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:49:49 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:49:50 user nova-compute[73012]: INFO nova.compute.manager [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Detaching volume f92558b5-e9c7-4da6-ad19-c57193e6ce54
Aug 14 12:49:50 user nova-compute[73012]: INFO nova.virt.block_device [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Attempting to driver detach volume f92558b5-e9c7-4da6-ad19-c57193e6ce54 from mountpoint /dev/vdc
Aug 14 12:49:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Attempting to detach device vdc from instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:49:50 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:49:50 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:49:50 user nova-compute[73012]:   <target dev="vdc" bus="virtio"/>
Aug 14 12:49:50 user nova-compute[73012]:   <serial>f92558b5-e9c7-4da6-ad19-c57193e6ce54</serial>
Aug 14 12:49:50 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 12:49:50 user nova-compute[73012]: </disk>
Aug 14 12:49:50 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:49:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Successfully detached device vdc from instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d from the persistent domain config.
Aug 14 12:49:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:49:50 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:49:50 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:49:50 user nova-compute[73012]:   <target dev="vdc" bus="virtio"/>
Aug 14 12:49:50 user nova-compute[73012]:   <serial>f92558b5-e9c7-4da6-ad19-c57193e6ce54</serial>
Aug 14 12:49:50 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 12:49:50 user nova-compute[73012]: </disk>
Aug 14 12:49:50 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692017390.5166914, eb783a96-9cc0-4e35-9e91-9c536b9b8d5d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:49:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Successfully detached device vdc from instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d from the live domain config.
Aug 14 12:49:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tenJCHZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:49:50 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a38f73f-4ec9-439c-ba18-97b7547585ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59d8876-26c5-44bf-b2f5-0212aeaf99d9]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:49:50 user nova-compute[73012]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 (non-flash)
Aug 14 12:49:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:49:50 user nova-compute[73012]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 (non-flash)
Aug 14 12:49:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aace94790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[19182fdd-1dc7-4c62-ad39-5e29d04b3642]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0868861f-b708-4ab4-871a-5a8823fc5113]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5063b240-278e-419b-b9e2-119d75d22320]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e8dd4c-00c0-456f-bb4e-f4c3b502276e]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b3f9f-0ccb-4c32-a215-ac9075be874c]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db2d053-c719-41b0-b2a8-94a665058fa1]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54, portal: 172.16.0.220,3260]
Aug 14 12:49:50 user nova-compute[73012]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54, portal: 172.16.0.220,3260] successful.
Aug 14 12:49:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92558b5-e9c7-4da6-ad19-c57193e6ce54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6b7ca9-1470-47ac-8bca-eba6843c744e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] <== disconnect_volume: return (282ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:49:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:49:51 user nova-compute[73012]: DEBUG nova.objects.instance [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lazy-loading 'flavor' on Instance uuid eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:49:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-ec1fee18-8f16-4445-8aa8-2105577e1ecd tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.612s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:49:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:49:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:00 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-7bd136ec-aa66-4745-a2ec-99eee4207c88 req-7070194f-faef-4d0d-8402-bcc4044b716d service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received event network-changed-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:50:00 user nova-compute[73012]: DEBUG nova.compute.manager [req-7bd136ec-aa66-4745-a2ec-99eee4207c88 req-7070194f-faef-4d0d-8402-bcc4044b716d service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Refreshing instance network info cache due to event network-changed-038fb582-36e6-421c-9066-bbb636a3f5bf. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:50:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7bd136ec-aa66-4745-a2ec-99eee4207c88 req-7070194f-faef-4d0d-8402-bcc4044b716d service nova] Acquiring lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:50:00 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7bd136ec-aa66-4745-a2ec-99eee4207c88 req-7070194f-faef-4d0d-8402-bcc4044b716d service nova] Acquired lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:50:00 user nova-compute[73012]: DEBUG nova.network.neutron [req-7bd136ec-aa66-4745-a2ec-99eee4207c88 req-7070194f-faef-4d0d-8402-bcc4044b716d service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Refreshing network info cache for port 038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:50:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-7bd136ec-aa66-4745-a2ec-99eee4207c88 req-7070194f-faef-4d0d-8402-bcc4044b716d service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Updated VIF entry in instance network info cache for port 038fb582-36e6-421c-9066-bbb636a3f5bf. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:50:01 user nova-compute[73012]: DEBUG nova.network.neutron [req-7bd136ec-aa66-4745-a2ec-99eee4207c88 req-7070194f-faef-4d0d-8402-bcc4044b716d service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Updating instance_info_cache with network_info: [{"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:50:01 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-7bd136ec-aa66-4745-a2ec-99eee4207c88 req-7070194f-faef-4d0d-8402-bcc4044b716d service nova] Releasing lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:50:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'flavor' on Instance uuid d9d586e4-e2f6-4a19-9e51-a43964fccbfb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:50:02 user nova-compute[73012]: INFO nova.compute.manager [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Attaching volume 81cd1ade-01b2-4921-a124-53ed65fb5494 to /dev/vdb
Aug 14 12:50:02 user nova-compute[73012]: DEBUG os_brick.utils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca7427-f8ee-4d5d-afe4-2a96e89e1566]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e2cc30-d62c-4323-9756-3362c56ab646]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47c19ab-10a7-424f-a564-2bbaf19523d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f4d41-3ab6-4248-82ed-a02eacc4cb29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:50:02 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:50:02 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[60023bc9-9acb-4aae-b49d-2231116dd5c3]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG os_brick.utils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Updating existing volume attachment record: 7d3e6434-a243-4136-b128-621f6fdf76db {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:50:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:50:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:50:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:50:03 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:50:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:04 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73012) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 12:50:05 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:50:05 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:50:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=25.162975311279297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9f636897-a882-4c8b-8df7-a068a7ec2717 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance d9d586e4-e2f6-4a19-9e51-a43964fccbfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:50:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:50:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:07 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:07 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:07 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:07 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:08 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHyQvCcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:50:10 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:50:10 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:50:10 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d42a94-d48d-401b-8219-d3f4a8bf0d43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:50:10 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[22363b2d-8fe0-49eb-8885-1c3bc949f1d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494] added
Aug 14 12:50:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bfff0f-f330-40ff-b13d-f105c04b0517]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e06e51-9fb6-43d8-86eb-eff1d4872b10]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHyQvCcL {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gHyQvCcL" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead84a9a-a0d9-41e3-ab20-e3c8aad287a3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gHyQvCcL'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc1f110-c569-4944-ae2a-68c9463116f2]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[164d6fde-7a16-4f41-a182-d32fb8848712]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:50:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:50:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbc332d-16e8-4034-9343-7194df68fec9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494, portal: 172.16.0.220,3260]
Aug 14 12:50:10 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494, portal: 172.16.0.220,3260] successful.
Aug 14 12:50:10 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5408d071-91ec-46cc-a274-94ffdd70e147]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6778e489-4d3c-4e82-a232-0de58227a4c1]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:50:11 user nova-compute[73012]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 (non-flash)
Aug 14 12:50:11 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:50:11 user nova-compute[73012]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 (non-flash)
Aug 14 12:50:11 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49fc0c6-87bd-435c-9d68-7339308a9ccc]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHyQvCcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:50:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26165303532306161', 'path': '/dev/sdc'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165303532306161', 'path': '/dev/sdc'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'flavor' on Instance uuid d9d586e4-e2f6-4a19-9e51-a43964fccbfb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:50:12 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:50:12 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:50:12 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:50:12 user nova-compute[73012]:   <serial>81cd1ade-01b2-4921-a124-53ed65fb5494</serial>
Aug 14 12:50:12 user nova-compute[73012]: </disk>
Aug 14 12:50:12 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] No VIF found with MAC fa:16:3e:5f:17:cf, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cc0b1456-6606-4fa1-bcea-a51481dfdd08 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.227s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:50:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:50:14 user nova-compute[73012]: INFO nova.compute.manager [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Detaching volume 81cd1ade-01b2-4921-a124-53ed65fb5494
Aug 14 12:50:14 user nova-compute[73012]: INFO nova.virt.block_device [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Attempting to driver detach volume 81cd1ade-01b2-4921-a124-53ed65fb5494 from mountpoint /dev/vdb
Aug 14 12:50:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Attempting to detach device vdb from instance d9d586e4-e2f6-4a19-9e51-a43964fccbfb from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:50:14 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:50:14 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:50:14 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:50:14 user nova-compute[73012]:   <serial>81cd1ade-01b2-4921-a124-53ed65fb5494</serial>
Aug 14 12:50:14 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:50:14 user nova-compute[73012]: </disk>
Aug 14 12:50:14 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:50:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Successfully detached device vdb from instance d9d586e4-e2f6-4a19-9e51-a43964fccbfb from the persistent domain config.
Aug 14 12:50:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d9d586e4-e2f6-4a19-9e51-a43964fccbfb from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:50:14 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:50:14 user nova-compute[73012]:   <source dev="/dev/sdc"/>
Aug 14 12:50:14 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:50:14 user nova-compute[73012]:   <serial>81cd1ade-01b2-4921-a124-53ed65fb5494</serial>
Aug 14 12:50:14 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:50:14 user nova-compute[73012]: </disk>
Aug 14 12:50:14 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692017414.7798026, d9d586e4-e2f6-4a19-9e51-a43964fccbfb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d9d586e4-e2f6-4a19-9e51-a43964fccbfb {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:50:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Successfully detached device vdb from instance d9d586e4-e2f6-4a19-9e51-a43964fccbfb from the live domain config.
Aug 14 12:50:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gHyQvCcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:50:14 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7a5d5a-69e0-452d-a6b5-14f22e2019a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e03c9e-80a1-4e4a-8a78-1ad7748d8a65]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:50:14 user nova-compute[73012]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 (non-flash)
Aug 14 12:50:14 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:50:14 user nova-compute[73012]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 (non-flash)
Aug 14 12:50:14 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aace1d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494'): ({'sdc'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Removing single pathed devices sdc {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a3de7c-f05a-412c-8018-17da3e244c5a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2312d8a0-09ef-4638-abcd-249b5150ab00]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Flushing IO for device /dev/sdc {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75a7efd-e798-4cf1-a5b2-5e4279da0d5f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdaeb8c-06a5-4fff-bfa5-4b06cf16d4b4]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] SCSI volumes sdc have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[af169a1d-8538-461c-a4e3-1fd8c7bdb038]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b23b8f1-9853-45f3-b101-9791884d2d73]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494, portal: 172.16.0.220,3260]
Aug 14 12:50:15 user nova-compute[73012]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494, portal: 172.16.0.220,3260] successful.
Aug 14 12:50:15 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81cd1ade-01b2-4921-a124-53ed65fb5494 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd880170-180e-4c92-b1e4-e4cdcb2f18b6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] <== disconnect_volume: return (268ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'flavor' on Instance uuid d9d586e4-e2f6-4a19-9e51-a43964fccbfb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:50:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9ae8d2f2-7858-4698-9131-18994b3f9157 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:50:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:17 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:50:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:50:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:50:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:50:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:26 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:50:27 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:32 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:37 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:50:40 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:50:40 user nova-compute[73012]: INFO nova.compute.manager [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Detaching volume 6c0dfe19-34a2-4234-93d2-987b2be410ca
Aug 14 12:50:40 user nova-compute[73012]: INFO nova.virt.block_device [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Attempting to driver detach volume 6c0dfe19-34a2-4234-93d2-987b2be410ca from mountpoint /dev/vdb
Aug 14 12:50:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Attempting to detach device vdb from instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:50:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:50:40 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:50:40 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:50:40 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:50:40 user nova-compute[73012]:   <serial>6c0dfe19-34a2-4234-93d2-987b2be410ca</serial>
Aug 14 12:50:40 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:50:40 user nova-compute[73012]: </disk>
Aug 14 12:50:40 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:50:40 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Successfully detached device vdb from instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d from the persistent domain config.
Aug 14 12:50:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:50:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:50:40 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:50:40 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:50:40 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:50:40 user nova-compute[73012]:   <serial>6c0dfe19-34a2-4234-93d2-987b2be410ca</serial>
Aug 14 12:50:40 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:50:40 user nova-compute[73012]: </disk>
Aug 14 12:50:40 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692017441.126732, eb783a96-9cc0-4e35-9e91-9c536b9b8d5d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:50:41 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Successfully detached device vdb from instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d from the live domain config.
Aug 14 12:50:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wglpPIjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:50:41 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e1b068-1703-428d-b917-c28d18700493]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[086e7013-a45f-4559-919e-518e22e786e8]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:50:41 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca (non-flash)
Aug 14 12:50:41 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9aace1da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5f1d59-7040-45e7-bc08-41e6af64723a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d796cc-3031-45f8-8c62-8df19c72c1fa]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc6d555-a6ae-4dc3-892f-b1278b0f41a6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b7998d-b1f0-4c9b-b500-e00c7dce3e6f]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dd04e6-7ede-4c6f-9766-e5a8245dba25]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbfdcbc-7887-432f-8137-90a47d828982]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca, portal: 172.16.0.220,3260]
Aug 14 12:50:41 user nova-compute[73012]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca, portal: 172.16.0.220,3260] successful.
Aug 14 12:50:41 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0dfe19-34a2-4234-93d2-987b2be410ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2644eea-7edd-4c96-8b68-239020ce75c7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] <== disconnect_volume: return (269ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:50:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:50:42 user nova-compute[73012]: DEBUG nova.objects.instance [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lazy-loading 'flavor' on Instance uuid eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:50:42 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-69d6e9e8-aab2-4d31-aa62-200afb35b563 tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:50:42 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:50:47 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:52 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:50:57 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:51:02 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:51:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-af03e0b9-a83c-4d1a-9ee8-983f2f818853 req-e7c9d9c6-a18c-4efb-867e-9149bee56001 service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received event network-changed-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-af03e0b9-a83c-4d1a-9ee8-983f2f818853 req-e7c9d9c6-a18c-4efb-867e-9149bee56001 service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Refreshing instance network info cache due to event network-changed-038fb582-36e6-421c-9066-bbb636a3f5bf. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-af03e0b9-a83c-4d1a-9ee8-983f2f818853 req-e7c9d9c6-a18c-4efb-867e-9149bee56001 service nova] Acquiring lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-af03e0b9-a83c-4d1a-9ee8-983f2f818853 req-e7c9d9c6-a18c-4efb-867e-9149bee56001 service nova] Acquired lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-af03e0b9-a83c-4d1a-9ee8-983f2f818853 req-e7c9d9c6-a18c-4efb-867e-9149bee56001 service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Refreshing network info cache for port 038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:05 user nova-compute[73012]: INFO nova.compute.manager [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Terminating instance
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.compute.manager [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-a780d031-16b7-4d39-86f5-8cd93243655e req-72fcf999-6892-407e-9418-9eb37bc166ff service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received event network-vif-unplugged-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a780d031-16b7-4d39-86f5-8cd93243655e req-72fcf999-6892-407e-9418-9eb37bc166ff service nova] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a780d031-16b7-4d39-86f5-8cd93243655e req-72fcf999-6892-407e-9418-9eb37bc166ff service nova] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-a780d031-16b7-4d39-86f5-8cd93243655e req-72fcf999-6892-407e-9418-9eb37bc166ff service nova] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-a780d031-16b7-4d39-86f5-8cd93243655e req-72fcf999-6892-407e-9418-9eb37bc166ff service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] No waiting events found dispatching network-vif-unplugged-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.compute.manager [req-a780d031-16b7-4d39-86f5-8cd93243655e req-72fcf999-6892-407e-9418-9eb37bc166ff service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received event network-vif-unplugged-038fb582-36e6-421c-9066-bbb636a3f5bf for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-af03e0b9-a83c-4d1a-9ee8-983f2f818853 req-e7c9d9c6-a18c-4efb-867e-9149bee56001 service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Updated VIF entry in instance network info cache for port 038fb582-36e6-421c-9066-bbb636a3f5bf. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.network.neutron [req-af03e0b9-a83c-4d1a-9ee8-983f2f818853 req-e7c9d9c6-a18c-4efb-867e-9149bee56001 service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Updating instance_info_cache with network_info: [{"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-af03e0b9-a83c-4d1a-9ee8-983f2f818853 req-e7c9d9c6-a18c-4efb-867e-9149bee56001 service nova] Releasing lock "refresh_cache-d9d586e4-e2f6-4a19-9e51-a43964fccbfb" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:51:05 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Instance destroyed successfully.
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.objects.instance [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'resources' on Instance uuid d9d586e4-e2f6-4a19-9e51-a43964fccbfb {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1431617872',display_name='tempest-TestStampPattern-server-1431617872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1431617872',id=52,image_ref='f530bf3c-72be-4018-a9d0-373bf600fb33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyY0+OY/CO/IIvMQ5wsjRAn/w+1oNa4ySH/gHvhGG3ROhkdKEAFgypHmb7QNsy/eRvRhukohjwyhL3nWH2e9muZBjpJv5rJjMoL4gDXL3THZUUwL60K1ST/tWlaiDNE7Q==',key_name='tempest-TestStampPattern-1351324735',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5b635614658433dba3cfd95bbeb2212',ramdisk_id='',reservation_id='r-v15ti7hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9f636897-a882-4c8b-8df7-a068a7ec2717',image_min_disk='1',image_min_ram='0',image_owner_id='b5b635614658433dba3cfd95bbeb2212',image_owner_project_name='tempest-TestStampPattern-1040723128',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1040723128-project-member',image_user_id='8e94d26c7cf044b3a33424a6bad7c3ac',owner_project_name='tempest-TestStampPattern-1040723128',owner_user_name='tempest-TestStampPattern-1040723128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:48:16Z,user_data=None,user_id='8e94d26c7cf044b3a33424a6bad7c3ac',uuid=d9d586e4-e2f6-4a19-9e51-a43964fccbfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converting VIF {"id": "038fb582-36e6-421c-9066-bbb636a3f5bf", "address": "fa:16:3e:5f:17:cf", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fb582-36", "ovs_interfaceid": "038fb582-36e6-421c-9066-bbb636a3f5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:17:cf,bridge_name='br-int',has_traffic_filtering=True,id=038fb582-36e6-421c-9066-bbb636a3f5bf,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fb582-36') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG os_vif [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:17:cf,bridge_name='br-int',has_traffic_filtering=True,id=038fb582-36e6-421c-9066-bbb636a3f5bf,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fb582-36') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap038fb582-36, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:05 user nova-compute[73012]: INFO os_vif [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:17:cf,bridge_name='br-int',has_traffic_filtering=True,id=038fb582-36e6-421c-9066-bbb636a3f5bf,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fb582-36')
Aug 14 12:51:05 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Deleting instance files /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb_del
Aug 14 12:51:05 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Deletion of /opt/stack/data/nova/instances/d9d586e4-e2f6-4a19-9e51-a43964fccbfb_del complete
Aug 14 12:51:05 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:51:06 user nova-compute[73012]: INFO nova.compute.manager [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:51:06 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Error from libvirt while getting description of instance-00000034: [Error Code 42] Domain not found: no domain with matching uuid 'd9d586e4-e2f6-4a19-9e51-a43964fccbfb' (instance-00000034): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd9d586e4-e2f6-4a19-9e51-a43964fccbfb' (instance-00000034)
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:51:06 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Took 0.57 seconds to deallocate network for instance.
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-2b1a012f-8074-4c55-b206-a2459ab7bcb8 req-c76e9515-cd52-43ea-9cf4-f928de73cb3b service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received event network-vif-deleted-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:51:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:51:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8628MB free_disk=25.16183090209961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.057s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:07 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Deleted allocations for instance d9d586e4-e2f6-4a19-9e51-a43964fccbfb
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9f636897-a882-4c8b-8df7-a068a7ec2717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-c84846d4-85d5-439d-980d-abe05ae87ff2 tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.209s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-f827a0bc-5c79-451d-8470-32b6e8c93bec req-dc38d015-2550-4b39-bfd2-ba89463e672f service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received event network-vif-plugged-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f827a0bc-5c79-451d-8470-32b6e8c93bec req-dc38d015-2550-4b39-bfd2-ba89463e672f service nova] Acquiring lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f827a0bc-5c79-451d-8470-32b6e8c93bec req-dc38d015-2550-4b39-bfd2-ba89463e672f service nova] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f827a0bc-5c79-451d-8470-32b6e8c93bec req-dc38d015-2550-4b39-bfd2-ba89463e672f service nova] Lock "d9d586e4-e2f6-4a19-9e51-a43964fccbfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.manager [req-f827a0bc-5c79-451d-8470-32b6e8c93bec req-dc38d015-2550-4b39-bfd2-ba89463e672f service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] No waiting events found dispatching network-vif-plugged-038fb582-36e6-421c-9066-bbb636a3f5bf {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:51:07 user nova-compute[73012]: WARNING nova.compute.manager [req-f827a0bc-5c79-451d-8470-32b6e8c93bec req-dc38d015-2550-4b39-bfd2-ba89463e672f service nova] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Received unexpected event network-vif-plugged-038fb582-36e6-421c-9066-bbb636a3f5bf for instance with vm_state deleted and task_state None.
Aug 14 12:51:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:51:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:51:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:51:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:51:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:51:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:51:11 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:51:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:51:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:51:11 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:51:12 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updating instance_info_cache with network_info: [{"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:51:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:51:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:51:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:51:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:16 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:51:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:51:20 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692017465.897854, d9d586e4-e2f6-4a19-9e51-a43964fccbfb => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:51:20 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] VM Stopped (Lifecycle Event)
Aug 14 12:51:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-2b289370-ff4a-4991-95a4-cd37c2928355 None None] [instance: d9d586e4-e2f6-4a19-9e51-a43964fccbfb] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:51:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:51:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:30 user nova-compute[73012]: INFO nova.compute.manager [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Terminating instance
Aug 14 12:51:30 user nova-compute[73012]: DEBUG nova.compute.manager [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-cbc4229b-4807-4e39-a32e-9b27478ee4b3 req-f7966818-b5e2-4b8b-a282-bdd3ab15d7e0 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received event network-vif-unplugged-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cbc4229b-4807-4e39-a32e-9b27478ee4b3 req-f7966818-b5e2-4b8b-a282-bdd3ab15d7e0 service nova] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cbc4229b-4807-4e39-a32e-9b27478ee4b3 req-f7966818-b5e2-4b8b-a282-bdd3ab15d7e0 service nova] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-cbc4229b-4807-4e39-a32e-9b27478ee4b3 req-f7966818-b5e2-4b8b-a282-bdd3ab15d7e0 service nova] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-cbc4229b-4807-4e39-a32e-9b27478ee4b3 req-f7966818-b5e2-4b8b-a282-bdd3ab15d7e0 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] No waiting events found dispatching network-vif-unplugged-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG nova.compute.manager [req-cbc4229b-4807-4e39-a32e-9b27478ee4b3 req-f7966818-b5e2-4b8b-a282-bdd3ab15d7e0 service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received event network-vif-unplugged-a691822b-bcf6-4ec1-b783-69477153a5b4 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:51:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Instance destroyed successfully.
Aug 14 12:51:31 user nova-compute[73012]: DEBUG nova.objects.instance [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lazy-loading 'resources' on Instance uuid eb783a96-9cc0-4e35-9e91-9c536b9b8d5d {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-926817035',display_name='tempest-TestServerVolumeAttachmentScenario-server-926817035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-926817035',id=51,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzGWjwNRdo8VdEc1SvXcGiiwRQN71JYUCqlDKZBPRznR1FqoFhcjCaYdXBMpT5uMdEp2dOYIUf6YPyN+gJi6r/SYAeCD+DFHbJ8q/vnCgVqX7cwm/AaryG7r4gPEUB1SQ==',key_name='tempest-keypair-734511039',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5606415b860e48bba4c25b1625cdc909',ramdisk_id='',reservation_id='r-7q78ace0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1213091456',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1213091456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1175227d96cc4644ba81166382f1dfa9',uuid=eb783a96-9cc0-4e35-9e91-9c536b9b8d5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Converting VIF {"id": "a691822b-bcf6-4ec1-b783-69477153a5b4", "address": "fa:16:3e:aa:10:75", "network": {"id": "e48d2405-aa41-4e3c-b631-10ad28c5dfe9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1522428416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5606415b860e48bba4c25b1625cdc909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa691822b-bc", "ovs_interfaceid": "a691822b-bcf6-4ec1-b783-69477153a5b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:10:75,bridge_name='br-int',has_traffic_filtering=True,id=a691822b-bcf6-4ec1-b783-69477153a5b4,network=Network(e48d2405-aa41-4e3c-b631-10ad28c5dfe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa691822b-bc') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG os_vif [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:10:75,bridge_name='br-int',has_traffic_filtering=True,id=a691822b-bcf6-4ec1-b783-69477153a5b4,network=Network(e48d2405-aa41-4e3c-b631-10ad28c5dfe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa691822b-bc') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa691822b-bc, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:51:31 user nova-compute[73012]: INFO os_vif [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:10:75,bridge_name='br-int',has_traffic_filtering=True,id=a691822b-bcf6-4ec1-b783-69477153a5b4,network=Network(e48d2405-aa41-4e3c-b631-10ad28c5dfe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa691822b-bc')
Aug 14 12:51:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Deleting instance files /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d_del
Aug 14 12:51:31 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Deletion of /opt/stack/data/nova/instances/eb783a96-9cc0-4e35-9e91-9c536b9b8d5d_del complete
Aug 14 12:51:31 user nova-compute[73012]: INFO nova.compute.manager [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 14 12:51:31 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:51:31 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:51:32 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:51:32 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Took 1.03 seconds to deallocate network for instance.
Aug 14 12:51:32 user nova-compute[73012]: DEBUG nova.compute.manager [req-10bd2c18-7210-41cc-b5c9-ddc238e16466 req-d3ecebfb-12fc-4132-b21e-f60750c0e5ce service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received event network-vif-deleted-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:51:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:32 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:32 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:51:32 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:51:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:33 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Deleted allocations for instance eb783a96-9cc0-4e35-9e91-9c536b9b8d5d
Aug 14 12:51:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-cf577c8c-6fe3-484b-96f4-db7de7efab2f tempest-TestServerVolumeAttachmentScenario-1213091456 tempest-TestServerVolumeAttachmentScenario-1213091456-project-member] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.158s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-5401ebc6-7ed1-47e1-b21f-bac3c0eb6807 req-0d70fd0d-ebb1-4c39-8c5f-c779d492497c service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received event network-vif-plugged-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:51:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5401ebc6-7ed1-47e1-b21f-bac3c0eb6807 req-0d70fd0d-ebb1-4c39-8c5f-c779d492497c service nova] Acquiring lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:51:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5401ebc6-7ed1-47e1-b21f-bac3c0eb6807 req-0d70fd0d-ebb1-4c39-8c5f-c779d492497c service nova] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:51:33 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-5401ebc6-7ed1-47e1-b21f-bac3c0eb6807 req-0d70fd0d-ebb1-4c39-8c5f-c779d492497c service nova] Lock "eb783a96-9cc0-4e35-9e91-9c536b9b8d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:51:33 user nova-compute[73012]: DEBUG nova.compute.manager [req-5401ebc6-7ed1-47e1-b21f-bac3c0eb6807 req-0d70fd0d-ebb1-4c39-8c5f-c779d492497c service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] No waiting events found dispatching network-vif-plugged-a691822b-bcf6-4ec1-b783-69477153a5b4 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:51:33 user nova-compute[73012]: WARNING nova.compute.manager [req-5401ebc6-7ed1-47e1-b21f-bac3c0eb6807 req-0d70fd0d-ebb1-4c39-8c5f-c779d492497c service nova] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Received unexpected event network-vif-plugged-a691822b-bcf6-4ec1-b783-69477153a5b4 for instance with vm_state deleted and task_state None.
Aug 14 12:51:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:51:46 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692017491.6952293, eb783a96-9cc0-4e35-9e91-9c536b9b8d5d => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:51:46 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] VM Stopped (Lifecycle Event)
Aug 14 12:51:46 user nova-compute[73012]: DEBUG nova.compute.manager [None req-88ab0d19-2e64-482b-8808-483c39e34bae None None] [instance: eb783a96-9cc0-4e35-9e91-9c536b9b8d5d] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:51:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:51:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:51:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:51:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:51:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:51:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:00 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:06 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:52:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:52:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:52:06 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:52:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:52:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.190235137939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance 9f636897-a882-4c8b-8df7-a068a7ec2717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:52:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:52:08 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:52:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:10 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:10 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:10 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:52:12 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:52:12 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-58b7861d-4def-46a4-8ac6-b56911a22b0d req-14f98bd9-3db9-4473-9c56-10306013dda6 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-changed-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG nova.compute.manager [req-58b7861d-4def-46a4-8ac6-b56911a22b0d req-14f98bd9-3db9-4473-9c56-10306013dda6 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Refreshing instance network info cache due to event network-changed-0eab5865-c52c-45bc-a6dd-9c80631117ac. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-58b7861d-4def-46a4-8ac6-b56911a22b0d req-14f98bd9-3db9-4473-9c56-10306013dda6 service nova] Acquiring lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-58b7861d-4def-46a4-8ac6-b56911a22b0d req-14f98bd9-3db9-4473-9c56-10306013dda6 service nova] Acquired lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG nova.network.neutron [req-58b7861d-4def-46a4-8ac6-b56911a22b0d req-14f98bd9-3db9-4473-9c56-10306013dda6 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Refreshing network info cache for port 0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:13 user nova-compute[73012]: INFO nova.compute.manager [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Terminating instance
Aug 14 12:52:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-e4f1e03c-a92d-4f1b-80bc-9f0644b4ff0e req-570472fb-1394-46c7-b9e9-7aaa0a040fc5 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-vif-unplugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e4f1e03c-a92d-4f1b-80bc-9f0644b4ff0e req-570472fb-1394-46c7-b9e9-7aaa0a040fc5 service nova] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e4f1e03c-a92d-4f1b-80bc-9f0644b4ff0e req-570472fb-1394-46c7-b9e9-7aaa0a040fc5 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e4f1e03c-a92d-4f1b-80bc-9f0644b4ff0e req-570472fb-1394-46c7-b9e9-7aaa0a040fc5 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-e4f1e03c-a92d-4f1b-80bc-9f0644b4ff0e req-570472fb-1394-46c7-b9e9-7aaa0a040fc5 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] No waiting events found dispatching network-vif-unplugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-e4f1e03c-a92d-4f1b-80bc-9f0644b4ff0e req-570472fb-1394-46c7-b9e9-7aaa0a040fc5 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-vif-unplugged-0eab5865-c52c-45bc-a6dd-9c80631117ac for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.network.neutron [req-58b7861d-4def-46a4-8ac6-b56911a22b0d req-14f98bd9-3db9-4473-9c56-10306013dda6 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updated VIF entry in instance network info cache for port 0eab5865-c52c-45bc-a6dd-9c80631117ac. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.network.neutron [req-58b7861d-4def-46a4-8ac6-b56911a22b0d req-14f98bd9-3db9-4473-9c56-10306013dda6 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [{"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-58b7861d-4def-46a4-8ac6-b56911a22b0d req-14f98bd9-3db9-4473-9c56-10306013dda6 service nova] Releasing lock "refresh_cache-9f636897-a882-4c8b-8df7-a068a7ec2717" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Instance destroyed successfully.
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.objects.instance [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lazy-loading 'resources' on Instance uuid 9f636897-a882-4c8b-8df7-a068a7ec2717 {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1568061317',display_name='tempest-TestStampPattern-server-1568061317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1568061317',id=50,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyY0+OY/CO/IIvMQ5wsjRAn/w+1oNa4ySH/gHvhGG3ROhkdKEAFgypHmb7QNsy/eRvRhukohjwyhL3nWH2e9muZBjpJv5rJjMoL4gDXL3THZUUwL60K1ST/tWlaiDNE7Q==',key_name='tempest-TestStampPattern-1351324735',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:45:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5b635614658433dba3cfd95bbeb2212',ramdisk_id='',reservation_id='r-mdida70b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1040723128',owner_user_name='tempest-TestStampPattern-1040723128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:48:07Z,user_data=None,user_id='8e94d26c7cf044b3a33424a6bad7c3ac',uuid=9f636897-a882-4c8b-8df7-a068a7ec2717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converting VIF {"id": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "address": "fa:16:3e:88:b5:4e", "network": {"id": "6f109d58-7cda-4cb7-bbba-377605a3d70d", "bridge": "br-int", "label": "tempest-TestStampPattern-1138293963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b635614658433dba3cfd95bbeb2212", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eab5865-c5", "ovs_interfaceid": "0eab5865-c52c-45bc-a6dd-9c80631117ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=0eab5865-c52c-45bc-a6dd-9c80631117ac,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eab5865-c5') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG os_vif [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=0eab5865-c52c-45bc-a6dd-9c80631117ac,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eab5865-c5') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0eab5865-c5, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:52:14 user nova-compute[73012]: INFO os_vif [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=0eab5865-c52c-45bc-a6dd-9c80631117ac,network=Network(6f109d58-7cda-4cb7-bbba-377605a3d70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eab5865-c5')
Aug 14 12:52:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Deleting instance files /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717_del
Aug 14 12:52:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Deletion of /opt/stack/data/nova/instances/9f636897-a882-4c8b-8df7-a068a7ec2717_del complete
Aug 14 12:52:14 user nova-compute[73012]: INFO nova.compute.manager [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 14 12:52:14 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 12:52:14 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:52:15 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Took 0.58 seconds to deallocate network for instance.
Aug 14 12:52:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG nova.compute.manager [req-121aae66-7a56-4148-98a6-6a1a553838af req-adba2dc7-7599-4f2b-bca2-ae1f0115a04c service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-vif-deleted-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:52:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:15 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Deleted allocations for instance 9f636897-a882-4c8b-8df7-a068a7ec2717
Aug 14 12:52:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-a11fe7e0-4f64-4e3b-a689-813b4fcaf71b tempest-TestStampPattern-1040723128 tempest-TestStampPattern-1040723128-project-member] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.730s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] No waiting events found dispatching network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:52:16 user nova-compute[73012]: WARNING nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received unexpected event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac for instance with vm_state deleted and task_state None.
Aug 14 12:52:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] No waiting events found dispatching network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:52:16 user nova-compute[73012]: WARNING nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received unexpected event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac for instance with vm_state deleted and task_state None.
Aug 14 12:52:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] No waiting events found dispatching network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:52:16 user nova-compute[73012]: WARNING nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received unexpected event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac for instance with vm_state deleted and task_state None.
Aug 14 12:52:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Acquiring lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] Lock "9f636897-a882-4c8b-8df7-a068a7ec2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:52:16 user nova-compute[73012]: DEBUG nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] No waiting events found dispatching network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:52:16 user nova-compute[73012]: WARNING nova.compute.manager [req-e637aafb-dea2-4ec8-a217-363d641a4a7d req-3b7dec59-fd00-4ad2-bd7d-a438d98bea93 service nova] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Received unexpected event network-vif-plugged-0eab5865-c52c-45bc-a6dd-9c80631117ac for instance with vm_state deleted and task_state None.
Aug 14 12:52:16 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:52:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:52:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:52:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:52:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:52:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:52:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:52:29 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692017534.5621302, 9f636897-a882-4c8b-8df7-a068a7ec2717 => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:52:29 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] VM Stopped (Lifecycle Event)
Aug 14 12:52:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b1920d8a-a79c-4da6-be29-320570c8c2d3 None None] [instance: 9f636897-a882-4c8b-8df7-a068a7ec2717] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:52:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:52:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:52:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:52:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:52:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:37 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:52:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:52:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:52:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:52:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:52:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:52:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:52:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:52:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:53:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:53:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:53:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:53:06 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:53:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:53:07 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:53:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.314056396484375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:53:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:53:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:53:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:53:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:53:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:53:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:53:07 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:53:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:53:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:53:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:53:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:53:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:53:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:53:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:53:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:53:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:14 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:53:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_power_states {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:53:24 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:29 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:34 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:53:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:44 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:49 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:54 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:53:59 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:04 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:05 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:54:06 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:54:06 user nova-compute[73012]: DEBUG nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Starting instance... {{(pid=73012) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73012) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 12:54:07 user nova-compute[73012]: INFO nova.compute.claims [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Claim successful on node user
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Start building networks asynchronously for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Allocating IP information in the background. {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.network.neutron [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] allocate_for_instance() {{(pid=73012) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 12:54:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Start building block device mappings for instance. {{(pid=73012) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.policy [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e097f2eaf2f94097bb01d0cbf6af0945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc828f52995c40d4b62e229964be1105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73012) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Start spawning the instance on the hypervisor. {{(pid=73012) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Creating instance directory {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 12:54:07 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Creating image(s)
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "/opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "/opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.249s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "788023b248ef244c328f1ffefa1a27e1b90c7061" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:54:07 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.293s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk 1073741824 {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061,backing_fmt=raw /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk 1073741824" returned: 0 in 0.064s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "788023b248ef244c328f1ffefa1a27e1b90c7061" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/788023b248ef244c328f1ffefa1a27e1b90c7061 --force-share --output=json" returned: 0 in 0.204s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk. size=1073741824 {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG nova.virt.disk.api [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Cannot resize image /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk to a smaller size. {{(pid=73012) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 12:54:08 user nova-compute[73012]: DEBUG nova.objects.instance [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'migration_context' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.network.neutron [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Successfully created port: ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Created local disks {{(pid=73012) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Ensure instance console log exists: /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/console.log {{(pid=73012) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:54:09 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:54:09 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=25.29947280883789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:54:09 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Successfully updated port: ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Building network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-33cd12f6-a8f4-48b4-b2ad-da046bf699f8 req-2853d32c-5755-4575-b76a-009dc62da1b3 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received event network-changed-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.compute.manager [req-33cd12f6-a8f4-48b4-b2ad-da046bf699f8 req-2853d32c-5755-4575-b76a-009dc62da1b3 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Refreshing instance network info cache due to event network-changed-ed7cd681-a816-4f11-9b5e-ac9deea87dd0. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-33cd12f6-a8f4-48b4-b2ad-da046bf699f8 req-2853d32c-5755-4575-b76a-009dc62da1b3 service nova] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Instance cache missing network info. {{(pid=73012) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.network.neutron [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Instance network_info: |[{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73012) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-33cd12f6-a8f4-48b4-b2ad-da046bf699f8 req-2853d32c-5755-4575-b76a-009dc62da1b3 service nova] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.network.neutron [req-33cd12f6-a8f4-48b4-b2ad-da046bf699f8 req-2853d32c-5755-4575-b76a-009dc62da1b3 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Refreshing network info cache for port ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Start _get_guest_xml network_info=[{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'f1c1bbe4-a191-4a75-9890-606d22f47ada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 12:54:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:54:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] CPU controller missing on host. {{(pid=73012) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.host [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] CPU controller found on host. {{(pid=73012) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73012) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T12:01:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T12:01:46Z,direct_url=<?>,disk_format='qcow2',id=f1c1bbe4-a191-4a75-9890-606d22f47ada,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e880c854ecce45f797f2a36534273c60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T12:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Flavor limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Image limits 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Flavor pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Image pref 0:0:0 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73012) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Got 1 possible topologies {{(pid=73012) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.hardware [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73012) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1242717082',display_name='tempest-SnapshotDataIntegrityTests-server-1242717082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1242717082',id=53,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcPfj64AKudA9VV5i4aOVbrvBI7UGiIS48U1Rhgs0QEBP4Z+520T+ClDmNmsnXM38HtP3lrtJQ+mKgkhHivMMoJdhsaMTfwvks1ZFNzwBsLinOVlbJmWoqi3MrG+aQ/EA==',key_name='tempest-keypair-200647153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc828f52995c40d4b62e229964be1105',ramdisk_id='',reservation_id='r-wb0tjfts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-826713120',owner_user_name='tempest-SnapshotDataIntegrityTests-826713120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e097f2eaf2f94097bb01d0cbf6af0945',uuid=bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73012) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Converting VIF {"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:9d:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd681-a816-4f11-9b5e-ac9deea87dd0,network=Network(86ff57a2-7324-4a45-b3df-bbb79cfba89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped7cd681-a8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.objects.instance [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'pci_devices' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 12:54:10 user nova-compute[73012]:   <uuid>bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c</uuid>
Aug 14 12:54:10 user nova-compute[73012]:   <name>instance-00000035</name>
Aug 14 12:54:10 user nova-compute[73012]:   <memory>524288</memory>
Aug 14 12:54:10 user nova-compute[73012]:   <vcpu>1</vcpu>
Aug 14 12:54:10 user nova-compute[73012]:   <metadata>
Aug 14 12:54:10 user nova-compute[73012]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 12:54:10 user nova-compute[73012]:       <nova:package version="0.0.0"/>
Aug 14 12:54:10 user nova-compute[73012]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1242717082</nova:name>
Aug 14 12:54:10 user nova-compute[73012]:       <nova:creationTime>2023-08-14 12:54:10</nova:creationTime>
Aug 14 12:54:10 user nova-compute[73012]:       <nova:flavor name="m1.tiny">
Aug 14 12:54:10 user nova-compute[73012]:         <nova:memory>512</nova:memory>
Aug 14 12:54:10 user nova-compute[73012]:         <nova:disk>1</nova:disk>
Aug 14 12:54:10 user nova-compute[73012]:         <nova:swap>0</nova:swap>
Aug 14 12:54:10 user nova-compute[73012]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 12:54:10 user nova-compute[73012]:         <nova:vcpus>1</nova:vcpus>
Aug 14 12:54:10 user nova-compute[73012]:       </nova:flavor>
Aug 14 12:54:10 user nova-compute[73012]:       <nova:owner>
Aug 14 12:54:10 user nova-compute[73012]:         <nova:user uuid="e097f2eaf2f94097bb01d0cbf6af0945">tempest-SnapshotDataIntegrityTests-826713120-project-member</nova:user>
Aug 14 12:54:10 user nova-compute[73012]:         <nova:project uuid="fc828f52995c40d4b62e229964be1105">tempest-SnapshotDataIntegrityTests-826713120</nova:project>
Aug 14 12:54:10 user nova-compute[73012]:       </nova:owner>
Aug 14 12:54:10 user nova-compute[73012]:       <nova:root type="image" uuid="f1c1bbe4-a191-4a75-9890-606d22f47ada"/>
Aug 14 12:54:10 user nova-compute[73012]:       <nova:ports>
Aug 14 12:54:10 user nova-compute[73012]:         <nova:port uuid="ed7cd681-a816-4f11-9b5e-ac9deea87dd0">
Aug 14 12:54:10 user nova-compute[73012]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 12:54:10 user nova-compute[73012]:         </nova:port>
Aug 14 12:54:10 user nova-compute[73012]:       </nova:ports>
Aug 14 12:54:10 user nova-compute[73012]:     </nova:instance>
Aug 14 12:54:10 user nova-compute[73012]:   </metadata>
Aug 14 12:54:10 user nova-compute[73012]:   <sysinfo type="smbios">
Aug 14 12:54:10 user nova-compute[73012]:     <system>
Aug 14 12:54:10 user nova-compute[73012]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 12:54:10 user nova-compute[73012]:       <entry name="product">OpenStack Nova</entry>
Aug 14 12:54:10 user nova-compute[73012]:       <entry name="version">0.0.0</entry>
Aug 14 12:54:10 user nova-compute[73012]:       <entry name="serial">bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c</entry>
Aug 14 12:54:10 user nova-compute[73012]:       <entry name="uuid">bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c</entry>
Aug 14 12:54:10 user nova-compute[73012]:       <entry name="family">Virtual Machine</entry>
Aug 14 12:54:10 user nova-compute[73012]:     </system>
Aug 14 12:54:10 user nova-compute[73012]:   </sysinfo>
Aug 14 12:54:10 user nova-compute[73012]:   <os>
Aug 14 12:54:10 user nova-compute[73012]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 12:54:10 user nova-compute[73012]:     <boot dev="hd"/>
Aug 14 12:54:10 user nova-compute[73012]:     <smbios mode="sysinfo"/>
Aug 14 12:54:10 user nova-compute[73012]:   </os>
Aug 14 12:54:10 user nova-compute[73012]:   <features>
Aug 14 12:54:10 user nova-compute[73012]:     <acpi/>
Aug 14 12:54:10 user nova-compute[73012]:     <apic/>
Aug 14 12:54:10 user nova-compute[73012]:     <vmcoreinfo/>
Aug 14 12:54:10 user nova-compute[73012]:   </features>
Aug 14 12:54:10 user nova-compute[73012]:   <clock offset="utc">
Aug 14 12:54:10 user nova-compute[73012]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 12:54:10 user nova-compute[73012]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 12:54:10 user nova-compute[73012]:     <timer name="hpet" present="no"/>
Aug 14 12:54:10 user nova-compute[73012]:   </clock>
Aug 14 12:54:10 user nova-compute[73012]:   <cpu mode="custom" match="exact">
Aug 14 12:54:10 user nova-compute[73012]:     <model>Nehalem</model>
Aug 14 12:54:10 user nova-compute[73012]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 12:54:10 user nova-compute[73012]:   </cpu>
Aug 14 12:54:10 user nova-compute[73012]:   <devices>
Aug 14 12:54:10 user nova-compute[73012]:     <disk type="file" device="disk">
Aug 14 12:54:10 user nova-compute[73012]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 12:54:10 user nova-compute[73012]:       <source file="/opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk"/>
Aug 14 12:54:10 user nova-compute[73012]:       <target dev="vda" bus="virtio"/>
Aug 14 12:54:10 user nova-compute[73012]:     </disk>
Aug 14 12:54:10 user nova-compute[73012]:     <interface type="ethernet">
Aug 14 12:54:10 user nova-compute[73012]:       <mac address="fa:16:3e:69:9d:a3"/>
Aug 14 12:54:10 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:54:10 user nova-compute[73012]:       <mtu size="1442"/>
Aug 14 12:54:10 user nova-compute[73012]:       <target dev="taped7cd681-a8"/>
Aug 14 12:54:10 user nova-compute[73012]:     </interface>
Aug 14 12:54:10 user nova-compute[73012]:     <serial type="pty">
Aug 14 12:54:10 user nova-compute[73012]:       <log file="/opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/console.log" append="off"/>
Aug 14 12:54:10 user nova-compute[73012]:     </serial>
Aug 14 12:54:10 user nova-compute[73012]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 12:54:10 user nova-compute[73012]:     <video>
Aug 14 12:54:10 user nova-compute[73012]:       <model type="virtio"/>
Aug 14 12:54:10 user nova-compute[73012]:     </video>
Aug 14 12:54:10 user nova-compute[73012]:     <rng model="virtio">
Aug 14 12:54:10 user nova-compute[73012]:       <backend model="random">/dev/urandom</backend>
Aug 14 12:54:10 user nova-compute[73012]:     </rng>
Aug 14 12:54:10 user nova-compute[73012]:     <controller type="usb" index="0" model="none"/>
Aug 14 12:54:10 user nova-compute[73012]:     <memballoon model="virtio">
Aug 14 12:54:10 user nova-compute[73012]:       <stats period="10"/>
Aug 14 12:54:10 user nova-compute[73012]:     </memballoon>
Aug 14 12:54:10 user nova-compute[73012]:   </devices>
Aug 14 12:54:10 user nova-compute[73012]: </domain>
Aug 14 12:54:10 user nova-compute[73012]:  {{(pid=73012) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1242717082',display_name='tempest-SnapshotDataIntegrityTests-server-1242717082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1242717082',id=53,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcPfj64AKudA9VV5i4aOVbrvBI7UGiIS48U1Rhgs0QEBP4Z+520T+ClDmNmsnXM38HtP3lrtJQ+mKgkhHivMMoJdhsaMTfwvks1ZFNzwBsLinOVlbJmWoqi3MrG+aQ/EA==',key_name='tempest-keypair-200647153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc828f52995c40d4b62e229964be1105',ramdisk_id='',reservation_id='r-wb0tjfts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-826713120',owner_user_name='tempest-SnapshotDataIntegrityTests-826713120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T12:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e097f2eaf2f94097bb01d0cbf6af0945',uuid=bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Converting VIF {"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:9d:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd681-a816-4f11-9b5e-ac9deea87dd0,network=Network(86ff57a2-7324-4a45-b3df-bbb79cfba89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped7cd681-a8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG os_vif [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:9d:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd681-a816-4f11-9b5e-ac9deea87dd0,network=Network(86ff57a2-7324-4a45-b3df-bbb79cfba89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped7cd681-a8') {{(pid=73012) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped7cd681-a8, may_exist=True, interface_attrs={}) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped7cd681-a8, col_values=(('external_ids', {'iface-id': 'ed7cd681-a816-4f11-9b5e-ac9deea87dd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:9d:a3', 'vm-uuid': 'bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c'}),), if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:10 user nova-compute[73012]: INFO os_vif [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:9d:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd681-a816-4f11-9b5e-ac9deea87dd0,network=Network(86ff57a2-7324-4a45-b3df-bbb79cfba89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped7cd681-a8')
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:54:10 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No VIF found with MAC fa:16:3e:69:9d:a3, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:54:11 user nova-compute[73012]: DEBUG nova.network.neutron [req-33cd12f6-a8f4-48b4-b2ad-da046bf699f8 req-2853d32c-5755-4575-b76a-009dc62da1b3 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updated VIF entry in instance network info cache for port ed7cd681-a816-4f11-9b5e-ac9deea87dd0. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:54:11 user nova-compute[73012]: DEBUG nova.network.neutron [req-33cd12f6-a8f4-48b4-b2ad-da046bf699f8 req-2853d32c-5755-4575-b76a-009dc62da1b3 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:54:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-33cd12f6-a8f4-48b4-b2ad-da046bf699f8 req-2853d32c-5755-4575-b76a-009dc62da1b3 service nova] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:54:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:12 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:12 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-506598e1-8f50-434f-8090-2fcd2d02db91 req-eb43b997-043b-48e8-a2f2-6ee92a2832c5 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received event network-vif-plugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:54:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-506598e1-8f50-434f-8090-2fcd2d02db91 req-eb43b997-043b-48e8-a2f2-6ee92a2832c5 service nova] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:54:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-506598e1-8f50-434f-8090-2fcd2d02db91 req-eb43b997-043b-48e8-a2f2-6ee92a2832c5 service nova] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:54:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-506598e1-8f50-434f-8090-2fcd2d02db91 req-eb43b997-043b-48e8-a2f2-6ee92a2832c5 service nova] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:54:12 user nova-compute[73012]: DEBUG nova.compute.manager [req-506598e1-8f50-434f-8090-2fcd2d02db91 req-eb43b997-043b-48e8-a2f2-6ee92a2832c5 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] No waiting events found dispatching network-vif-plugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:54:12 user nova-compute[73012]: WARNING nova.compute.manager [req-506598e1-8f50-434f-8090-2fcd2d02db91 req-eb43b997-043b-48e8-a2f2-6ee92a2832c5 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received unexpected event network-vif-plugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 for instance with vm_state building and task_state spawning.
Aug 14 12:54:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:13 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:54:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:54:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Skipping network cache update for instance because it is Building. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 12:54:13 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 12:54:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-feaffb17-17f0-4da0-8c12-845a398f6dcd req-72965f5e-5bec-4a76-b325-e4c993e5744e service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received event network-vif-plugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-feaffb17-17f0-4da0-8c12-845a398f6dcd req-72965f5e-5bec-4a76-b325-e4c993e5744e service nova] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-feaffb17-17f0-4da0-8c12-845a398f6dcd req-72965f5e-5bec-4a76-b325-e4c993e5744e service nova] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-feaffb17-17f0-4da0-8c12-845a398f6dcd req-72965f5e-5bec-4a76-b325-e4c993e5744e service nova] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.compute.manager [req-feaffb17-17f0-4da0-8c12-845a398f6dcd req-72965f5e-5bec-4a76-b325-e4c993e5744e service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] No waiting events found dispatching network-vif-plugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 12:54:14 user nova-compute[73012]: WARNING nova.compute.manager [req-feaffb17-17f0-4da0-8c12-845a398f6dcd req-72965f5e-5bec-4a76-b325-e4c993e5744e service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received unexpected event network-vif-plugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 for instance with vm_state building and task_state spawning.
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692017654.8916786, bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c => Resumed> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:54:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] VM Resumed (Lifecycle Event)
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Instance event wait completed in 0 seconds for  {{(pid=73012) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Guest created on hypervisor {{(pid=73012) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 12:54:14 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Instance spawned successfully.
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Found default for hw_cdrom_bus of ide {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Found default for hw_disk_bus of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Found default for hw_input_bus of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Found default for hw_pointer_model of None {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Found default for hw_video_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Found default for hw_vif_model of virtio {{(pid=73012) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 12:54:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.virt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Emitting event <LifecycleEvent: 1692017654.891983, bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c => Started> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 12:54:14 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] VM Started (Lifecycle Event)
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:54:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73012) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 12:54:15 user nova-compute[73012]: INFO nova.compute.manager [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 12:54:15 user nova-compute[73012]: INFO nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Took 7.39 seconds to spawn the instance on the hypervisor.
Aug 14 12:54:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 12:54:15 user nova-compute[73012]: INFO nova.compute.manager [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Took 8.21 seconds to build instance.
Aug 14 12:54:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-eb9bf177-333b-478b-91a2-716dae5fa5a7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.478s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:54:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:54:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:54:28 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:54:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:54:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:54:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:54:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:54:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:55:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:06 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:55:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:55:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:55:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:55:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:55:09 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:55:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:55:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:55:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:55:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:55:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:55:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=25.267417907714844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:55:12 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:55:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:55:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:55:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:55:14 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:55:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:55:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:55:14 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:55:14 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:55:15 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:55:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:55:15 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:55:15 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:55:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:55:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:55:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:55:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:55:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:55:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:39 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:55:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:55:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:55:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:55:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-faa27c0e-3a33-460d-90a1-4a490827fccb req-a62b87b3-a83b-4bc6-a8d0-9e84e73c6362 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received event network-changed-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 12:55:58 user nova-compute[73012]: DEBUG nova.compute.manager [req-faa27c0e-3a33-460d-90a1-4a490827fccb req-a62b87b3-a83b-4bc6-a8d0-9e84e73c6362 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Refreshing instance network info cache due to event network-changed-ed7cd681-a816-4f11-9b5e-ac9deea87dd0. {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 12:55:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-faa27c0e-3a33-460d-90a1-4a490827fccb req-a62b87b3-a83b-4bc6-a8d0-9e84e73c6362 service nova] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:55:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-faa27c0e-3a33-460d-90a1-4a490827fccb req-a62b87b3-a83b-4bc6-a8d0-9e84e73c6362 service nova] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:55:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-faa27c0e-3a33-460d-90a1-4a490827fccb req-a62b87b3-a83b-4bc6-a8d0-9e84e73c6362 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Refreshing network info cache for port ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 12:55:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-faa27c0e-3a33-460d-90a1-4a490827fccb req-a62b87b3-a83b-4bc6-a8d0-9e84e73c6362 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updated VIF entry in instance network info cache for port ed7cd681-a816-4f11-9b5e-ac9deea87dd0. {{(pid=73012) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 12:55:58 user nova-compute[73012]: DEBUG nova.network.neutron [req-faa27c0e-3a33-460d-90a1-4a490827fccb req-a62b87b3-a83b-4bc6-a8d0-9e84e73c6362 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:55:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-faa27c0e-3a33-460d-90a1-4a490827fccb req-a62b87b3-a83b-4bc6-a8d0-9e84e73c6362 service nova] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:56:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:56:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG nova.objects.instance [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:56:03 user nova-compute[73012]: INFO nova.compute.manager [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attaching volume 52b6d16b-2229-4a10-9aa1-e45a6a98105b to /dev/vdb
Aug 14 12:56:03 user nova-compute[73012]: DEBUG os_brick.utils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d38232-3fad-41f9-9284-220039ffc212]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8584a85d-c7d4-4194-84ff-e9940676bef3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d2a472-e388-4e2b-a0e7-48c957fff442]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2195944a-a1d5-46cf-b6f3-379c2e4f5612]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:56:03 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:56:03 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[02780c7b-1837-40e9-b59f-d778398c2944]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG os_brick.utils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:56:03 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating existing volume attachment record: aeda4e3a-2e1c-43ff-ad65-0b7823babc94 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:56:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:08 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:56:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:56:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:56:09 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:56:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:56:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:56:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.258216857910156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:56:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMwBfimp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:56:12 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:56:12 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:56:12 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[63354270-9858-41b1-a085-2e03944c1b8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:56:12 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[842b365b-9e9c-49bf-a9e5-4df86be5a7e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b] added
Aug 14 12:56:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec84f25-b387-4dca-b698-731f22c557d9]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25f5f58-92be-482e-9b01-81cea2838542]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMwBfimp {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMwBfimp" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0d8c77-7c72-4a54-bbdf-435c255a7b23]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMwBfimp'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[475613b3-659b-4a1d-a01e-ca8523dcb60a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb00af8-99be-4b08-a534-23cf21cfb9e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:56:12 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:56:12 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:56:12 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:56:12 user nova-compute[73012]: 
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e83f67-ccd9-43fa-9b52-e8c374398b9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b, portal: 172.16.0.220,3260]
Aug 14 12:56:12 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b, portal: 172.16.0.220,3260] successful.
Aug 14 12:56:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab937624-38c5-480d-9fe9-993b6cafedcb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f34a732-cb49-4ad3-81c6-2291eb5ca0b5]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b (non-flash)
Aug 14 12:56:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b (non-flash)
Aug 14 12:56:12 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adab9eb-7884-44c4-aff7-e1da8cba1a30]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMwBfimp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:56:12 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:56:13 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26362363137366638', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:56:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362363137366638', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:56:13 user nova-compute[73012]: DEBUG nova.objects.instance [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:56:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:56:13 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:56:13 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:56:13 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:56:13 user nova-compute[73012]:   <serial>52b6d16b-2229-4a10-9aa1-e45a6a98105b</serial>
Aug 14 12:56:13 user nova-compute[73012]: </disk>
Aug 14 12:56:13 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:56:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:56:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:56:13 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No VIF found with MAC fa:16:3e:69:9d:a3, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:56:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-5e65696e-5143-4da7-b307-10dd53e879a3 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.626s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:56:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:15 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:56:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:16 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:56:16 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:56:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:56:16 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:56:16 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:56:16 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:56:17 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:56:17 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:56:17 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:56:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:56:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:56:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:56:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:56:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:56:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:56:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:56:36 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:56:36 user nova-compute[73012]: INFO nova.compute.manager [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Detaching volume 52b6d16b-2229-4a10-9aa1-e45a6a98105b
Aug 14 12:56:36 user nova-compute[73012]: INFO nova.virt.block_device [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attempting to driver detach volume 52b6d16b-2229-4a10-9aa1-e45a6a98105b from mountpoint /dev/vdb
Aug 14 12:56:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Attempting to detach device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:56:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:56:36 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:56:36 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:56:36 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:56:36 user nova-compute[73012]:   <serial>52b6d16b-2229-4a10-9aa1-e45a6a98105b</serial>
Aug 14 12:56:36 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:56:36 user nova-compute[73012]: </disk>
Aug 14 12:56:36 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:56:36 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully detached device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the persistent domain config.
Aug 14 12:56:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:56:36 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:56:36 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:56:36 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:56:36 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:56:36 user nova-compute[73012]:   <serial>52b6d16b-2229-4a10-9aa1-e45a6a98105b</serial>
Aug 14 12:56:36 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:56:36 user nova-compute[73012]: </disk>
Aug 14 12:56:36 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692017797.114422, bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:56:37 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully detached device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the live domain config.
Aug 14 12:56:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMwBfimp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:56:37 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d224c7-55d9-4203-b979-643d74cd458d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dc4d4a-dfc6-4780-af54-3fae3f669a4e]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b (non-flash)
Aug 14 12:56:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b (non-flash)
Aug 14 12:56:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0149d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf2276a-da80-48b8-b5f5-39a8bf36be73]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c43330-eb1f-4daa-94e3-56099dcad584]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.134s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c591ce1-59b1-4946-bc57-9bb1f55058a9]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74c4189-116f-4910-a603-fad76a8f6ace]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb98f7a1-f577-4f73-9a73-49c93c69530d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a017f93e-7eca-4a17-8567-92e1a47d096f]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b, portal: 172.16.0.220,3260]
Aug 14 12:56:37 user nova-compute[73012]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b, portal: 172.16.0.220,3260] successful.
Aug 14 12:56:37 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b6d16b-2229-4a10-9aa1-e45a6a98105b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd3291-1b4e-4bf9-820b-a29c2e220956]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== disconnect_volume: return (371ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:56:37 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:56:38 user nova-compute[73012]: DEBUG nova.objects.instance [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:56:38 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-f4fc58d5-5566-4fce-8090-433a5d9d7585 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.680s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:56:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:56:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:56:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:56:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:56:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:56:50 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:56:55 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:00 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:02 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:57:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:57:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:57:05 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:09 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:57:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:57:09 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:57:09 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:57:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:09 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:57:10 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:57:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.257095336914062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 12:57:10 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:11 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:57:11 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:57:11 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:57:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:57:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:15 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:57:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:57:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:57:15 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:57:18 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:57:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:57:18 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:57:18 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:57:18 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:57:19 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:57:19 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:57:19 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:57:20 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:25 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:57:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:57:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:57:30 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:57:30 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:57:30 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:57:31 user nova-compute[73012]: INFO nova.compute.manager [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attaching volume ccc5ac38-d979-411d-a085-2c28ab0d0d0a to /dev/vdb
Aug 14 12:57:31 user nova-compute[73012]: DEBUG os_brick.utils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3d6c3-5a74-44b4-abae-19aabfb5576b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebb809b-2640-4ad0-8571-2170e9ff3fef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad2bb95-330c-421e-8d80-e1d5ce4b5d5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a82e53f-f186-4a7d-bc8e-b48bae0842c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:57:31 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:57:31 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ad9bc-6329-4a13-9c50-155d91e55cba]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG os_brick.utils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating existing volume attachment record: 8a02128a-b997-4343-a173-b9483d98b0ad {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:57:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:35 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:37 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 12:57:37 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjIuTKYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:57:39 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:57:39 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:57:39 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b3b6ed-2ea6-4236-ac38-78d181b82013]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:57:39 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0fc9dc-212c-42dc-8267-f15e1d9fd80e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a] added
Aug 14 12:57:39 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[29612e4f-14ab-40d7-acaf-c60f6af79431]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab2f464-abfc-4257-ad31-1728b06ef7ea]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjIuTKYt {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjIuTKYt" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c6876-ce53-4e2d-8ad4-a3a21d3164c7]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UjIuTKYt'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4930cf9-5295-4086-919d-71c9dac21a1e]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d39636-3386-4796-9f1c-5b6e83d92976]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:57:39 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:57:39 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:57:39 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:57:39 user nova-compute[73012]: 
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72c32e5-804f-444b-8401-0180c1d3e8a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a, portal: 172.16.0.220,3260]
Aug 14 12:57:39 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a, portal: 172.16.0.220,3260] successful.
Aug 14 12:57:39 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[50642ff5-4454-48da-b53d-772e036c7c99]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc4c5b-3025-45ce-9bc0-3af95bf3d9b7]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a (non-flash)
Aug 14 12:57:39 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a (non-flash)
Aug 14 12:57:39 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[579f32f7-fc7b-4a3e-a097-ac7e8c3a8e5f]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:57:39 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjIuTKYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:57:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:57:40 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23830326161613535', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:57:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830326161613535', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:57:40 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:57:40 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:57:40 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:57:40 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:57:40 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:57:40 user nova-compute[73012]:   <serial>ccc5ac38-d979-411d-a085-2c28ab0d0d0a</serial>
Aug 14 12:57:40 user nova-compute[73012]: </disk>
Aug 14 12:57:40 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:57:40 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:57:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:57:41 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No VIF found with MAC fa:16:3e:69:9d:a3, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:57:41 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dbe41726-e96b-4df3-bd48-11432ae83f49 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.302s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:57:43 user nova-compute[73012]: INFO nova.compute.manager [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Detaching volume ccc5ac38-d979-411d-a085-2c28ab0d0d0a
Aug 14 12:57:43 user nova-compute[73012]: INFO nova.virt.block_device [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attempting to driver detach volume ccc5ac38-d979-411d-a085-2c28ab0d0d0a from mountpoint /dev/vdb
Aug 14 12:57:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Attempting to detach device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:57:43 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:57:43 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:57:43 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:57:43 user nova-compute[73012]:   <serial>ccc5ac38-d979-411d-a085-2c28ab0d0d0a</serial>
Aug 14 12:57:43 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:57:43 user nova-compute[73012]: </disk>
Aug 14 12:57:43 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:57:43 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully detached device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the persistent domain config.
Aug 14 12:57:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:57:43 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:57:43 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:57:43 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:57:43 user nova-compute[73012]:   <serial>ccc5ac38-d979-411d-a085-2c28ab0d0d0a</serial>
Aug 14 12:57:43 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:57:43 user nova-compute[73012]: </disk>
Aug 14 12:57:43 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692017863.8014853, bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:57:43 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully detached device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the live domain config.
Aug 14 12:57:43 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjIuTKYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:57:43 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[927e2209-595a-40fa-904d-fcf07abec573]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[47baea45-bb7e-437a-b588-67bb54dcdaac]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a (non-flash)
Aug 14 12:57:43 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a (non-flash)
Aug 14 12:57:43 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad0172710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3896e863-264f-4ee4-b7a7-55ef85ecbbf0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede6c2ef-a3fc-4b23-ae38-ae51790c092d]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c788efec-3db1-4846-9741-0ed9ebf60cf3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c9dfb-56b1-4e57-b1a9-fe623694131c]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8df1d1-6854-4e2c-bffc-16dc0c4902d6]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:43 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f672b261-5cbb-4b45-afd4-0ee9bae6c547]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a, portal: 172.16.0.220,3260]
Aug 14 12:57:44 user nova-compute[73012]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a, portal: 172.16.0.220,3260] successful.
Aug 14 12:57:44 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccc5ac38-d979-411d-a085-2c28ab0d0d0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e60f7-54f0-444c-9391-c59c1cee2258]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== disconnect_volume: return (251ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:57:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-dfacddb4-3602-4d8a-9365-e9d90fb8f791 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.624s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:57:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:57:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:57:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:57:45 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:51 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:57:51 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances with incomplete migration  {{(pid=73012) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 12:57:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:57:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:57:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:57:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:57:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:57:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:58:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:58:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:58:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:58:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:58:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:58:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.256061553955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:58:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:58:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:58:16 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:58:20 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:58:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:58:20 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:58:20 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:58:20 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:58:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:58:21 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:58:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:58:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:58:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:58:27 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:27 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:58:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:58:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:58:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:58:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:58:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:34 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:58:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:58:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:58:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:58:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:58:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG nova.objects.instance [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:58:37 user nova-compute[73012]: INFO nova.compute.manager [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attaching volume 71ee6a63-7c53-46ef-af8d-bb47463bf06e to /dev/vdb
Aug 14 12:58:37 user nova-compute[73012]: DEBUG os_brick.utils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f63840e-289d-4120-9e53-225a73646068]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f25d2b5-f96f-4a52-9e41-eaa05518b329]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be43624-4783-4eb3-8cc9-353a89098211]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39278a6-b920-4157-a025-cb37137d62d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:58:37 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:58:37 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef55808b-6418-48ef-b2f3-f65d104757f7]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG os_brick.utils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:58:37 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating existing volume attachment record: 16314151-bf6a-4d32-8348-21aa07db15f3 {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:58:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCOJEZvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:58:46 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:58:46 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:58:46 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5127ec2-34df-4c43-90e4-c4a8b8baf906]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:58:46 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[771d3fdb-4acf-4ab4-a6ad-5f733d0ed8a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e] added
Aug 14 12:58:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8720d4-3a8b-4550-ac27-95a7393eb404]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4bc4b3-fafa-4892-8240-3d34f8c1a440]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCOJEZvm {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCOJEZvm" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00b237e-6021-492f-a760-26b5e98b8027]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YCOJEZvm'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cdd266-7711-40a5-a249-78d4c1c748e3]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd31f47-e778-4c44-8edd-7773b6408c11]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:58:46 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:58:46 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:58:46 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:58:46 user nova-compute[73012]: 
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da24661-291f-4722-b1ba-2f36a6f1109f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e, portal: 172.16.0.220,3260]
Aug 14 12:58:46 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e, portal: 172.16.0.220,3260] successful.
Aug 14 12:58:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.076s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b4c156-4586-4024-848f-d968d3a6ec8a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6125955-833e-4d99-82a5-8b761e39c0b3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e (non-flash)
Aug 14 12:58:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e (non-flash)
Aug 14 12:58:46 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8746a79e-7bf7-4c10-8334-86d08ab8a790]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCOJEZvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:58:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:58:47 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23138626466383066', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:58:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138626466383066', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:58:47 user nova-compute[73012]: DEBUG nova.objects.instance [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:58:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:58:47 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:58:47 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:58:47 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:58:47 user nova-compute[73012]:   <serial>71ee6a63-7c53-46ef-af8d-bb47463bf06e</serial>
Aug 14 12:58:47 user nova-compute[73012]: </disk>
Aug 14 12:58:47 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:58:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:58:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:58:47 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No VIF found with MAC fa:16:3e:69:9d:a3, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:58:48 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-8a2ce0f8-4696-4cfd-9429-daf0e0aec498 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.303s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:58:50 user nova-compute[73012]: INFO nova.compute.manager [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Detaching volume 71ee6a63-7c53-46ef-af8d-bb47463bf06e
Aug 14 12:58:50 user nova-compute[73012]: INFO nova.virt.block_device [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attempting to driver detach volume 71ee6a63-7c53-46ef-af8d-bb47463bf06e from mountpoint /dev/vdb
Aug 14 12:58:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Attempting to detach device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:58:50 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:58:50 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:58:50 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:58:50 user nova-compute[73012]:   <serial>71ee6a63-7c53-46ef-af8d-bb47463bf06e</serial>
Aug 14 12:58:50 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:58:50 user nova-compute[73012]: </disk>
Aug 14 12:58:50 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:58:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully detached device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the persistent domain config.
Aug 14 12:58:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:58:50 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:58:50 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:58:50 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:58:50 user nova-compute[73012]:   <serial>71ee6a63-7c53-46ef-af8d-bb47463bf06e</serial>
Aug 14 12:58:50 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:58:50 user nova-compute[73012]: </disk>
Aug 14 12:58:50 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692017930.6596105, bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:58:50 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully detached device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the live domain config.
Aug 14 12:58:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCOJEZvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:58:50 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a71f816-588a-4c1a-93f8-aeb3aa21d8c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffee5564-6d20-46b4-85c6-c94c5069118c]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e (non-flash)
Aug 14 12:58:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e (non-flash)
Aug 14 12:58:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad012ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f719e0a-e9a3-44bd-83d7-259f97f1e938]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[10895cf2-9113-437a-aaf7-382b1b0addc3]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9aa43a-9e2b-4ac6-bda5-c0ac6ca75e20]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6ddd31-675e-4b3d-bc4b-5261faf8fdf0]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[471271e1-8e60-4714-9acf-3ef2a2161cc4]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9e5338-4ee9-476f-9f56-e6fff2435d19]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e, portal: 172.16.0.220,3260]
Aug 14 12:58:50 user nova-compute[73012]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e, portal: 172.16.0.220,3260] successful.
Aug 14 12:58:50 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71ee6a63-7c53-46ef-af8d-bb47463bf06e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ce080c-f6b1-441e-9841-35f7505f8edd]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== disconnect_volume: return (273ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:58:50 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:58:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:58:51 user nova-compute[73012]: DEBUG nova.objects.instance [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:58:51 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-b5c1679b-e1c5-4a4e-9fa7-77d3ce7a1957 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:58:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:59:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:59:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:59:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 12:59:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.249244689941406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 12:59:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:59:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:59:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:59:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:59:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:59:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 12:59:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:59:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 12:59:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 12:59:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 12:59:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:59:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:28 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 12:59:28 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 12:59:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:59:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG nova.objects.instance [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:59:44 user nova-compute[73012]: INFO nova.compute.manager [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attaching volume 90b9947c-cae2-4567-8984-1e8e9989a029 to /dev/vdb
Aug 14 12:59:44 user nova-compute[73012]: DEBUG os_brick.utils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e2fe7e-09ae-40ec-a674-7930c12d9c99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81eb1e41699e\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a88db3-2687-4e78-a04b-db8a01a02f1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9f1b2c-cd7f-475f-8b90-c6e7e44e5688]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[976dad31-6ed5-41ce-b999-b954f63d8f12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:44 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Running cmd (subprocess): nvme version {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] 'nvme version' failed. Not Retrying. {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:59:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] nvme not present on system {{(pid=73012) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 12:59:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:45 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 12:59:45 user nova-compute[73012]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 12:59:45 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de0ac7d-c8e2-4e8b-8733-c43151876b63]: (4, '') {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73012) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 12:59:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 12:59:45 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.lightos [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] LIGHTOS: no hostnqn found. {{(pid=73012) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 12:59:45 user nova-compute[73012]: DEBUG os_brick.utils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81eb1e41699e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:59:45 user nova-compute[73012]: DEBUG nova.virt.block_device [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating existing volume attachment record: 7b724b17-bbdc-46c9-b74c-73920c4e2c1a {{(pid=73012) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 12:59:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Calling os-brick to attach iSCSI Volume {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thXRONle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:59:53 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:59:53 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:59:53 user nova-compute[73012]: INFO os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2a8f78-da28-4168-8809-3d6f844ff08c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 12:59:53 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --interface default --op new {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dc1d76-96f7-4928-98af-a0f1c73edfbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029] added\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029] added
Aug 14 12:59:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[af95cab5-d7f7-43c9-9d84-1458f266745a]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dd3e06-66b7-435d-a2c7-4c0f01ba4fed]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v thXRONle {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v thXRONle" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d240dae2-7526-4010-8675-0c2064441caa]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'thXRONle'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a3301d-a6e4-4681-bcf3-baa1c597106f]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3e71e8-df25-4f3c-b05c-b435abace1e9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:59:53 user nova-compute[73012]:  {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 12:59:53 user nova-compute[73012]:  {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:59:53 user nova-compute[73012]: WARNING os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 12:59:53 user nova-compute[73012]: 
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --login {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6f3490-6bcc-4551-8837-1996f0e25e09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029, portal: 172.16.0.220,3260]
Aug 14 12:59:53 user nova-compute[73012]: Login to [iface: default, target: iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029, portal: 172.16.0.220,3260] successful.
Aug 14 12:59:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[479c56a4-04bd-41eb-9f06-3d46f9d66ebb]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa928a6f-2544-4d43-bfe4-9dbb04c8cb54]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 (non-flash)
Aug 14 12:59:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 (non-flash)
Aug 14 12:59:53 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Connected to 172.16.0.220:3260 {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73012) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73012) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c1a95-7e16-40ee-a1dc-e4de9be5e76b]: (4, ('- - 0', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:53 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73012) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thXRONle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73012) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23136633136303664', 'path': '/dev/sdb'} {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136633136303664', 'path': '/dev/sdb'} {{(pid=73012) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG nova.objects.instance [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 12:59:54 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:59:54 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:59:54 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:59:54 user nova-compute[73012]:   <serial>90b9947c-cae2-4567-8984-1e8e9989a029</serial>
Aug 14 12:59:54 user nova-compute[73012]: </disk>
Aug 14 12:59:54 user nova-compute[73012]:  {{(pid=73012) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No BDM found with device name vda, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73012) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] No VIF found with MAC fa:16:3e:69:9d:a3, not building metadata {{(pid=73012) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 12:59:54 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-35327ce6-2576-4c98-986a-972a386a2f93 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.014s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 12:59:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 12:59:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 12:59:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 12:59:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 12:59:57 user nova-compute[73012]: INFO nova.compute.manager [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Detaching volume 90b9947c-cae2-4567-8984-1e8e9989a029
Aug 14 12:59:57 user nova-compute[73012]: INFO nova.virt.block_device [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Attempting to driver detach volume 90b9947c-cae2-4567-8984-1e8e9989a029 from mountpoint /dev/vdb
Aug 14 12:59:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Attempting to detach device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the persistent domain config. {{(pid=73012) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:59:57 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:59:57 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:59:57 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:59:57 user nova-compute[73012]:   <serial>90b9947c-cae2-4567-8984-1e8e9989a029</serial>
Aug 14 12:59:57 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:59:57 user nova-compute[73012]: </disk>
Aug 14 12:59:57 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:59:57 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully detached device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the persistent domain config.
Aug 14 12:59:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the live domain config. {{(pid=73012) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.guest [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 12:59:57 user nova-compute[73012]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 12:59:57 user nova-compute[73012]:   <source dev="/dev/sdb"/>
Aug 14 12:59:57 user nova-compute[73012]:   <target dev="vdb" bus="virtio"/>
Aug 14 12:59:57 user nova-compute[73012]:   <serial>90b9947c-cae2-4567-8984-1e8e9989a029</serial>
Aug 14 12:59:57 user nova-compute[73012]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 12:59:57 user nova-compute[73012]: </disk>
Aug 14 12:59:57 user nova-compute[73012]:  {{(pid=73012) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-b4668723-9a77-485d-8d41-7ebc1e4cb6a9 None None] Received event <DeviceRemovedEvent: 1692017997.6001697, bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73012) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.driver [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 12:59:57 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully detached device vdb from instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c from the live domain config.
Aug 14 12:59:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] calling os-brick to detach iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9ad06833d0>, {'target_iqns': ['iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thXRONle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 12:59:57 user nova-compute[73012]: WARNING os_brick.initiator.connectors.base [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029', 0)] {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1553aea1-2214-4e4d-ae02-bd28c230a7b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa0e313-064c-4d58-a14f-fbc92b5a8f1c]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 (non-flash)\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 (non-flash)
Aug 14 12:59:57 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 (non-flash)
Aug 14 12:59:57 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9ad07db1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029'): ({'sdb'}, set())}) {{(pid=73012) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Removing single pathed devices sdb {{(pid=73012) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54a5546-0c98-4201-8641-8696a90a1f41]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d771fb47-5406-4683-a4b1-6027e7f60ff3]: (4, ('ok\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Flushing IO for device /dev/sdb {{(pid=73012) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[151bb414-e27c-41d7-8f09-4393941d8901]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73012) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fa1f90-1b5c-4396-a153-9aefc8012c5c]: (4, ('1', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.linuxscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] SCSI volumes sdb have been removed. {{(pid=73012) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029')] {{(pid=73012) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2e5759-5b44-4c41-ae99-79c49023539d]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --logout {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[23740171-d0a9-4161-ae2e-e63d89d13f42]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029, portal: 172.16.0.220,3260]
Aug 14 12:59:57 user nova-compute[73012]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029, portal: 172.16.0.220,3260] successful.
Aug 14 12:59:57 user nova-compute[73012]:  stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op delete {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b9947c-cae2-4567-8984-1e8e9989a029 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84070) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5494d605-48c4-4c8e-a082-ac6294225656]: (4, ('', '')) {{(pid=84070) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73012) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.base [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] <== disconnect_volume: return (250ms) None {{(pid=73012) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 12:59:57 user nova-compute[73012]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Disconnected iSCSI Volume {{(pid=73012) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 12:59:58 user nova-compute[73012]: DEBUG nova.objects.instance [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'flavor' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 12:59:58 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-26aa85b6-54a1-413e-8a96-566e7ea4ebc7 tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.552s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:00:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:11 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:00:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:00:11 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:00:11 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:00:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:00:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:00:11 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:00:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:00:12 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:00:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.247230529785156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:00:12 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:00:15 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:15 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:16 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:00:21 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:00:22 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:00:22 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:00:22 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:00:22 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:00:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:29 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:29 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:00:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:00:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:00:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:38 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:00:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:00:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:00:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:00:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:00:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:00:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:01:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:13 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:01:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:01:13 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:01:13 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:01:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:01:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:01:13 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG oslo_concurrency.processutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:01:14 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:01:14 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:01:14 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.246368408203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73012) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:01:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:01:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:01:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:17 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:20 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:01:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:01:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:01:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:01:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:01:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:01:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:01:23 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquired lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:01:23 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Forcefully refreshing network info cache for instance {{(pid=73012) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:01:23 user nova-compute[73012]: DEBUG nova.objects.instance [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lazy-loading 'info_cache' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:01:24 user nova-compute[73012]: DEBUG nova.network.neutron [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [{"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:01:24 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Releasing lock "refresh_cache-bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" {{(pid=73012) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:01:24 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updated the network info_cache for instance {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:01:24 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:01:25 user nova-compute[73012]: INFO nova.compute.manager [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Terminating instance
Aug 14 13:01:25 user nova-compute[73012]: DEBUG nova.compute.manager [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Start destroying the instance on the hypervisor. {{(pid=73012) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-f155f7b1-42ee-4fcf-8c90-177c3ed39a15 req-7a7ec237-d567-4242-8d42-22ad8479cfd1 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received event network-vif-unplugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f155f7b1-42ee-4fcf-8c90-177c3ed39a15 req-7a7ec237-d567-4242-8d42-22ad8479cfd1 service nova] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f155f7b1-42ee-4fcf-8c90-177c3ed39a15 req-7a7ec237-d567-4242-8d42-22ad8479cfd1 service nova] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-f155f7b1-42ee-4fcf-8c90-177c3ed39a15 req-7a7ec237-d567-4242-8d42-22ad8479cfd1 service nova] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-f155f7b1-42ee-4fcf-8c90-177c3ed39a15 req-7a7ec237-d567-4242-8d42-22ad8479cfd1 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] No waiting events found dispatching network-vif-unplugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG nova.compute.manager [req-f155f7b1-42ee-4fcf-8c90-177c3ed39a15 req-7a7ec237-d567-4242-8d42-22ad8479cfd1 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received event network-vif-unplugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 for instance with task_state deleting. {{(pid=73012) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:25 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [-] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Instance destroyed successfully.
Aug 14 13:01:26 user nova-compute[73012]: DEBUG nova.objects.instance [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lazy-loading 'resources' on Instance uuid bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c {{(pid=73012) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG nova.virt.libvirt.vif [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T12:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1242717082',display_name='tempest-SnapshotDataIntegrityTests-server-1242717082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1242717082',id=53,image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcPfj64AKudA9VV5i4aOVbrvBI7UGiIS48U1Rhgs0QEBP4Z+520T+ClDmNmsnXM38HtP3lrtJQ+mKgkhHivMMoJdhsaMTfwvks1ZFNzwBsLinOVlbJmWoqi3MrG+aQ/EA==',key_name='tempest-keypair-200647153',keypairs=<?>,launch_index=0,launched_at=2023-08-14T12:54:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc828f52995c40d4b62e229964be1105',ramdisk_id='',reservation_id='r-wb0tjfts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f1c1bbe4-a191-4a75-9890-606d22f47ada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-826713120',owner_user_name='tempest-SnapshotDataIntegrityTests-826713120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T12:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e097f2eaf2f94097bb01d0cbf6af0945',uuid=bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Converting VIF {"id": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "address": "fa:16:3e:69:9d:a3", "network": {"id": "86ff57a2-7324-4a45-b3df-bbb79cfba89f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1321070507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc828f52995c40d4b62e229964be1105", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped7cd681-a8", "ovs_interfaceid": "ed7cd681-a816-4f11-9b5e-ac9deea87dd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG nova.network.os_vif_util [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:9d:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd681-a816-4f11-9b5e-ac9deea87dd0,network=Network(86ff57a2-7324-4a45-b3df-bbb79cfba89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped7cd681-a8') {{(pid=73012) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG os_vif [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:9d:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd681-a816-4f11-9b5e-ac9deea87dd0,network=Network(86ff57a2-7324-4a45-b3df-bbb79cfba89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped7cd681-a8') {{(pid=73012) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped7cd681-a8, bridge=br-int, if_exists=True) {{(pid=73012) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:01:26 user nova-compute[73012]: INFO os_vif [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:9d:a3,bridge_name='br-int',has_traffic_filtering=True,id=ed7cd681-a816-4f11-9b5e-ac9deea87dd0,network=Network(86ff57a2-7324-4a45-b3df-bbb79cfba89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped7cd681-a8')
Aug 14 13:01:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Deleting instance files /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c_del
Aug 14 13:01:26 user nova-compute[73012]: INFO nova.virt.libvirt.driver [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Deletion of /opt/stack/data/nova/instances/bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c_del complete
Aug 14 13:01:26 user nova-compute[73012]: INFO nova.compute.manager [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 13:01:26 user nova-compute[73012]: DEBUG oslo.service.loopingcall [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73012) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG nova.compute.manager [-] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Deallocating network for instance {{(pid=73012) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:01:26 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] deallocate_for_instance() {{(pid=73012) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG nova.network.neutron [-] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Updating instance_info_cache with network_info: [] {{(pid=73012) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:01:27 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Took 1.05 seconds to deallocate network for instance.
Aug 14 13:01:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:01:27 user nova-compute[73012]: INFO nova.scheduler.client.report [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Deleted allocations for instance bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c
Aug 14 13:01:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-e6e551f1-5306-4f36-8e11-a90b15e40c6b tempest-SnapshotDataIntegrityTests-826713120 tempest-SnapshotDataIntegrityTests-826713120-project-member] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.222s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-ac42c35e-11a9-4c02-9b78-75ea9ba59599 req-7fe32026-5c37-4fbe-b71a-f6cd9a2c0159 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received event network-vif-plugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ac42c35e-11a9-4c02-9b78-75ea9ba59599 req-7fe32026-5c37-4fbe-b71a-f6cd9a2c0159 service nova] Acquiring lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ac42c35e-11a9-4c02-9b78-75ea9ba59599 req-7fe32026-5c37-4fbe-b71a-f6cd9a2c0159 service nova] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [req-ac42c35e-11a9-4c02-9b78-75ea9ba59599 req-7fe32026-5c37-4fbe-b71a-f6cd9a2c0159 service nova] Lock "bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:01:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-ac42c35e-11a9-4c02-9b78-75ea9ba59599 req-7fe32026-5c37-4fbe-b71a-f6cd9a2c0159 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] No waiting events found dispatching network-vif-plugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:01:27 user nova-compute[73012]: WARNING nova.compute.manager [req-ac42c35e-11a9-4c02-9b78-75ea9ba59599 req-7fe32026-5c37-4fbe-b71a-f6cd9a2c0159 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received unexpected event network-vif-plugged-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 for instance with vm_state deleted and task_state None.
Aug 14 13:01:27 user nova-compute[73012]: DEBUG nova.compute.manager [req-ac42c35e-11a9-4c02-9b78-75ea9ba59599 req-7fe32026-5c37-4fbe-b71a-f6cd9a2c0159 service nova] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Received event network-vif-deleted-ed7cd681-a816-4f11-9b5e-ac9deea87dd0 {{(pid=73012) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:01:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:31 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:01:31 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:01:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:01:41 user nova-compute[73012]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692018086.013589, bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c => Stopped> {{(pid=73012) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:01:41 user nova-compute[73012]: INFO nova.compute.manager [-] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] VM Stopped (Lifecycle Event)
Aug 14 13:01:41 user nova-compute[73012]: DEBUG nova.compute.manager [None req-960f7ec2-816e-41c7-baf2-2da7858aac6e None None] [instance: bb8dd570-fbd5-4eb2-9413-e4d9f1e95b7c] Checking state {{(pid=73012) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:01:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:01:46 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:51 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:01:56 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:01 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:03 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:06 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:02:11 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:02:14 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager.update_available_resource {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:02:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:02:14 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:02:14 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Auditing locally available compute resources for user (node: user) {{(pid=73012) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:02:15 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:02:15 user nova-compute[73012]: WARNING nova.virt.libvirt.driver [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.273761749267578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73012) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73012) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing inventories for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating ProviderTree inventory for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Updating inventory in ProviderTree for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing aggregate associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, aggregates: None {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Refreshing trait associations for resource provider 18c3368b-9ede-4a07-be2d-712c9b5eb568, traits: COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA {{(pid=73012) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.compute.provider_tree [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed in ProviderTree for provider: 18c3368b-9ede-4a07-be2d-712c9b5eb568 {{(pid=73012) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.scheduler.client.report [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Inventory has not changed for provider 18c3368b-9ede-4a07-be2d-712c9b5eb568 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73012) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG nova.compute.resource_tracker [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Compute_service record updated for user:user {{(pid=73012) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:02:15 user nova-compute[73012]: DEBUG oslo_concurrency.lockutils [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=73012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:02:16 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:02:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:18 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:19 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:19 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:21 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:21 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:22 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Starting heal instance info cache {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:02:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Rebuilding the list of instances to heal {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:02:23 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Didn't find any instances for network info cache update. {{(pid=73012) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 13:02:23 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:26 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:02:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:02:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:02:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:02:31 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:32 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:32 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73012) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:02:36 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:40 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:02:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Cleaning up deleted instances {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 13:02:40 user nova-compute[73012]: DEBUG nova.compute.manager [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] There are 0 instances to clean {{(pid=73012) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 13:02:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:02:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73012) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:02:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:02:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73012) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:02:41 user nova-compute[73012]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73012) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:02:44 user nova-compute[73012]: DEBUG oslo_service.periodic_task [None req-9906af0b-951a-4c04-bc11-60ab49fe379f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}